I'll volunteer the theremin for its total lack of any visual reference points, infinitely adjustable 'scale length' and the fact that you have to hold your entire body totally still to maintain a constant pitch!

I would have to second the theremin as the toughest to play and put it at #1 you want to see the difficulty check this out: