Olympus XZ-1 vs. Canon S95/S100

Someone else must have pondered over the decision between these two cameras. Were you happy or unhappy with your decisions? I don't take my DSLR with me as often as I "should", and therefore constantly miss good photographic opportunities. I was first drawn to the Canon, for it is much smaller of the two, but then I noticed that the lens is ridiculously slow. I was instantly reminded of my old Fuji F11, known for its good ISO capabilities, which you needed often! However, has anyone of you bought an XZ-1 only to find that it is too big and wished that you had bought the Canon?