Seeing AI Project

Seeing AI Project

In collaboration with Microsoft, Pivothead is working on bringing "vision" to the visually-impaired.

By combining APIs from Microsoft Cognitive Services with the imaging performance and power of Pivothead SMART, a person who is visually-impaired can better understand who and what is going on around them.

While wearing the glasses, the user swipes the touch panel on the eyewear to take a photo. The eyewear will analyze and translate the image to speech and describe what the person is doing, how old they are, and what emotion they're expressing. A user can take an image of text - from a nutrition label to a news article - and the eyewear will read it to the user.

Saqib Shaikh, a software developer for Microsoft, has played a key role in the project since day one. Shaikh, who lost his sight when he was seven years old, demonstrates the technology and explains how this enables him to be more independent in the video shown to the right.

Stay Updated

Custom Business Solutions

Microsoft and many others have seen the possibilities when it comes to the Pivothead interface and communications platform. We have spent extensive time and energy on R&D to understand the true capabilities through our existing native computer vision algorithms as well as other third-party software with which Pivothead can seamlessly work. It's just the beginning of the AI frontier and we believe the Pivothead solution has several real-world applications to leverage this technology so that the world may be a more integrated, connected, and efficient place.