Not exactly mentioned so far, but it is generally the case that a power supply which has a ground lead on the AC cord, will also have that ground lead connected to the negative of the output. Which is why Mike is suggesting that it has something to do with the odd behaviour.

You can verify that connection with a multimeter.

I'm sorry, probably I'm too noob to understand it, can you explain in different words where should I connect the multimeter?