I switched from the RX100, which I also found "great but grating" to an LX7 and am having a lot more fun with it. The RX100 has an amazing sensor and very small size and not much else. The LX7 has a much nicer lens, overwhelmingly better controls and interface, and a more comfortable size (if ultra small size isn't a huge priority). Between the faster and wider lens, the easily switchable multi-aspect sensor, the aperture ring and other controls, the ability to switch quickly and easily between auto and manual focus (and remember your last manual focus settings), I find the LX7 an overwhelmingly more enjoyable camera. I think the RX100 is undeniably better in low light at the wide end - other than that, I'll take the LX7.

I gave the RX100 to my wife. She leaves it in AUTO and snaps away and loves it. But if you want to interact with your gear more than that, it's a maddening camera.