I have opened a ticket on the sony forum and someone found a beginning of explaination: it's related to the pictures in contacts.
I've a Nexus 5 and the watch fails when I receive calls. But ..... it doesn't fails when the caller has no picture in its contact.

XDA Developers was founded by developers, for developers. It is now a valuable resource for people who want to make the most of their mobile devices, from customizing the look and feel to adding new functionality.Are you a developer?