Remember that this jack is also the headphone jack. The conversion from audio to USB data (+ and -) occurs in the circuit board within the adapter base. Also there is a common diode between the VCC and GND to ensure perfect isolation of VCC.

When charging is needed from anything other than the stock base, ground pin 3 and apply Vcc to pins 1, 2, and 4 on the audio jack.