Both cameras are good enough. They will not hold you back, and you cannot blame the camera if your pictures dont turn out great.

I chose the X-E1 because the fantastic manual handling, the beautiful lens range and that it has a larger sensor for more shallow DOF. And the low light performance. Most cameras perform OK in good light, it is photography in darkness that is the real challenge.

I also considered the NEX-6, but it felt more like a computer compared to the Fujifilm.