MIT finger device reads to the blind in real time

July 8, 2014
by Rodrique Ngowi

In this Thursday, June 26, 2014 photo, a model wears a FingerReader ring at the Massachusetts Institute of Technology's Media Lab in Cambridge, Mass. Researchers designed and developed the instrument, which enables people with visual disabilities to read text printed on paper or electronic devices. (AP Photo Stephan Savoia)

Scientists at the Massachusetts Institute of Technology are developing an audio reading device to be worn on the index finger of people whose vision is impaired, giving them affordable and immediate access to printed words.

The so-called FingerReader, a prototype produced by a 3-D printer, fits like a ring on the user's finger, equipped with a small camera that scans text. A synthesized voice reads words aloud, quickly translating books, restaurant menus and other needed materials for daily living, especially away from home or office.

Reading is as easy as pointing the finger at text. Special software tracks the finger movement, identifies words and processes the information. The device has vibration motors that alert readers when they stray from the script, said Roy Shilkrot, who is developing the device at the MIT Media Lab.

For Jerry Berrier, 62, who was born blind, the promise of the FingerReader is its portability and offer of real-time functionality at school, a doctor's office and restaurants.

"When I go to the doctor's office, there may be forms that I wanna read before I sign them," Berrier said.

He said there are other optical character recognition devices on the market for those with vision impairments, but none that he knows of that will read in real time.

Berrier manages training and evaluation for a federal program that distributes technology to low-income people in Massachusetts and Rhode Island who have lost their sight and hearing. He works from the Perkins School for the Blind in Watertown, Massachusetts.

In this Thursday, June 26, 2014 photo, a FingerReader ring lies on a book's page at the Massachusetts Institute of Technology's Media Lab in Cambridge, Mass. Researchers designed and developed the instrument, which enables people with visual disabilities to read text printed on paper or electronic devices. (AP Photo Stephan Savoia)

"Everywhere we go, for folks who are sighted, there are things that inform us about the products that we are about to interact with. I wanna be able to interact with those same products, regardless of how I have to do it," Berrier said.

Pattie Maes, an MIT professor who founded and leads the Fluid Interfaces research group developing the prototype, says the FingerReader is like "reading with the tip of your finger and it's a lot more flexible, a lot more immediate than any solution that they have right now."

Developing the gadget has taken three years of software coding, experimenting with various designs and working on feedback from a test group of visually impaired people. Much work remains before it is ready for the market, Shilkrot said, including making it work on cellphones.

Shilkrot said developers believe they will be able to affordably market the FingerReader but he could not yet estimate a price. The potential market includes some of the 11.2 million people in the United States with vision impairment, according to U.S. Census Bureau estimates.

Current technology used in homes and offices offers cumbersome scanners that must process the desired script before it can be read aloud by character-recognition software installed on a computer or smartphone, Shilkrot said. The FingerReader would not replace Braille—the system of raised dots that form words, interpreted by touch. Instead, Shilkrot said, the new device would enable users to access a vast number of books and other materials that are not currently available in Braille.

In this June 26, 2014 photo, a model wears a FingerReader ring at the Massachusetts Institute of Technology's Media Lab in Cambridge, Mass. Researchers designed and developed the instrument, which enables people with visual disabilities to read text printed on paper or electronic devices. (AP Photo Stephan Savoia)

Developers had to overcome unusual challenges to help people with visual impairments move their reading fingers along a straight line of printed text that they could not see. Users also had to be alerted at the beginning and end of the reading material.

Their solutions? Audio cues in the software that processes information from the FingerReader and vibration motors in the ring.

The FingerReader can read papers, books, magazines, newspapers, computer screens and other devices, but it has problems with text on a touch screen, said Shilkrot.

In this June 26, 2014 photo, a model wears a FingerReader ring at the Massachusetts Institute of Technology's Media Lab in Cambridge, Mass. Researchers designed and developed the instrument, which enables people with visual disabilities to read text printed on paper or electronic devices. (AP Photo Stephan Savoia)

That's because touching the screen with the tip of the finger would move text around, producing unintended results. Disabling the touch-screen function eliminates the problem, he said.

Berrier said affordable pricing could make the FingerReader a key tool to help people with vision impairment integrate into the modern information economy.

"Any tool that we can get that gives us better access to printed material helps us to live fuller, richer, more productive lives, Berrier said.

Related Stories

Even in a world of digital devices, braille continues to be a vital part of life for blind people. For nearly 200 years, this versatile writing system has allowed them to learn, work and live in a more independent way.

(Phys.org) —Samsung Electronics introduced a trio of accessories on Friday that are designed to help users who are disabled and visually impaired—those with partial or greater loss of vision. Their smartphones can be ...

Beyond canes and seeing-eye dogs, there is always room for more technology ideas to help the visually impaired ease up daily tasks that go beyond just walking and navigating sidewalks safely. MIT researchers have come up ...

(PhysOrg.com) -- To most of us, Braille is largely a mystery. It feels really cool, but the idea of actually reading it is kind of a pipe dream. Our sense of touch simply is not as sensitive as that of a blind person. That ...

A new app is about to come on the market with promises to dramatically increase the speed at which you read. Spritz is a text streaming technology that allows you to read a sentence, one word at a time. Each word is shown ...

To address the fact that many of us are on the go and pressed for time, app developers have devised speed-reading software that eliminates the time we supposedly waste by moving our eyes as we read. But don't throw away your ...

On the theory that a driver who knows when a red light will turn green is more relaxed and aware, vehicle manufacturer Audi is unveiling this week in Las Vegas a technology that enables vehicles to "read" traffic signals ...

There you are, cruising down the freeway, listening to some tunes and enjoying the view as your autonomous car zips and swerves through traffic. Then the fun ends and it becomes time take over the wheel. How smooth is that ...