Yes, it's normal. The clicking comes from a relay that is connected between an NTC thermistor, the main power inlet and the rest of the PSU, it's purpose is to cut the thermistor out of the circuit, once it has done it's purpose of limiting the inrush current at start-up. The turn-off click is from the relay reconnecting the thermistor.