Gordon mentioned in his night photography workshop to 'temporarily switch off anti-shake or IS when using a tripod because they can actually introduce wobbling as they attempt to counteract something which isn’t there'.

Could the same happen while shooting hand-held?
When shooting hand-held, should you always leave IS on or only turn it on when you actually need it?