Related Articles

An increasingly important -- and sometimes frustrating -- part of daily life is dealing with so-called "user interfaces." Whether it's a smartphone or an airport check-in system, the user's ability to get what they want out of the machine relies on their own adaptability to unfamiliar interfaces.

But what if you could simply talk to a machine the way you talk to a human being? And what if the machine could also ask you questions, or even address two different people at once?

These kinds of interactive abilities are being developed at KTH Royal Institute of Technology with the help of an award-winning robotic head that takes its name from the fur hat it wears.

With a computer-generated, animated face that is rear-projected on a 3D mask, Furhat is actually a platform for testing various interactive technologies, such as speech synthesis, speech recognition and eye-tracking. The robot can conduct conversations with multiple people, turning its head and looking each person straight in the eye, while moving its animated lips in synch with its words.

Samer Al Moubayed, one of the KTH researchers behind the development of Furhat, says the project represents the third generation of spoken dialogue systems that has been in development at KTH's Department for Speech, Music and Hearing during the last 15 years.

The Furhat team aims to develop its technology for commercial use, with the help of funding from Sweden's Vinnova, a government agency that supports innovation projects.The team behind the development of Furhat also includes: Jonas Beskow, Joakim Gustafson, and Gabriel Skantze.

"Furhat is becoming a popular research platform for scientists around the world who study human interaction with machines," Al Moubayed says. "It's very simple, it's potentially very cheap to make, and people want to use it in their own research areas."

Furhat also has attracted attention from researchers at Microsoft and Disney. "They have been following the development of Furhat for a long time," says Al Moubayed, who returned last week from a two-week visit to the U.S., where he presented the hardware and software behind Furhat at Microsoft's and Disney's research labs.

Al Moubayed says that Furhat has potential as an interactive user interface for a variety of applications. In schools, it could be used to conduct knowledge games with children. In assisted living centres, it could share information and chat with people.

Perched on a stand atop a bureau in Al Moubayed's office, Furhat greets a visitor and asks their name. It then addresses Al Moubayed, and after a couple more questions, asks if the visitor has any questions for Furhat. During a pause in the exchange, the robot offers to tell a joke.

Part of what sets Furhat apart from other interactive robots is its ability to make not only conversation, but eye contact -- an important element of communication.

"You want an interface that fulfills or reaches a critical quality that people can interact with in a natural way, otherwise the interaction you get is not natural anymore, and does not resemble how people interact with each other."

Furhat's ability to turn its face to multiple people in a conversation is enabled by face-tracking software. But its ability to make eye contact is achieved through projection. Unlike a 2D image, which can appear to be looking at everybody in the room at once -- a phenomenon known as the "Mona Lisa effect" -- Furhat appears to shift its gaze because the face is projected onto 3D-printed model of a human face.

"When we first experimented with this, the effect was strong immediately," Al Moubayed says. "You could bond with, or relate to, the face.

"It is an avatar that can really be present in the physical environment."

Such technologies are being explored as a potential therapeutic tool for children with autism and other disorders that affect social interaction, he says. The technology can also be used for telepresence applications in which 3D replicas of people's faces become the screens that we look at when conducting a video conference call.

"There are many different types of interest that drive this work," he says. "And we're just starting to explore its potential."

More From ScienceDaily

More Computers & Math News

Featured Research

Mar. 3, 2015 — By examining the forces that the segments of mosquito legs generate against a water surface, researchers have unraveled the mechanical logic that allows the mosquitoes to walk on water, which may ... full story

Mar. 3, 2015 — Major cities in the UK are falling behind their international counterparts in terms of their use of smart technologies, according to a new study. The research has found that smart cities in the UK, ... full story

Mar. 3, 2015 — To simulate chimp behavior, scientists created a computer model based on equations normally used to describe the movement of atoms and molecules in a confined space. An interdisciplinary research ... full story

Mar. 3, 2015 — Magnetic vortex structures, so-called skyrmions, could in future store and process information very efficiently. They could also be the basis for high-frequency components. For the first time, a team ... full story

Mar. 2, 2015 — The odds of picking a perfect bracket for the NCAA men's basketball March Madness championship tournament are a staggering less than one in 9.2 quintillion (that's 9,223,372,036,854,775,808), ... full story

Mar. 2, 2015 — Scientists report that they could observe experimentally the current flow along channels at the crystal surfaces of topological insulators. The channels are less than one nanometer wide and extend ... full story

Mar. 2, 2015 — Organic light emitting diodes (OLEDs), which are made from carbon-containing materials, have the potential to revolutionize future display technologies, making low-power displays so thin they'll wrap ... full story

Mar. 2, 2015 — What if one day, your computer, TV or smart phone could process data with light waves instead of an electrical current, making those devices faster, cheaper and more sustainable through less heat and ... full story

Mar. 2, 2015 — 3-D printing could become a powerful tool in customizing interventional radiology treatments to individual patient needs, with clinicians having the ability to construct devices to a specific size ... full story

Featured Videos

Forensic Holodeck Creates 3D Crime Scenes

Reuters - Innovations Video Online (Mar. 3, 2015) — A holodeck is no longer the preserve of TV sci-fi classic Star Trek, thanks to researchers from the Institute of Forensic Medicine Zurich, who have created what they say is the first system in the world to visualise the 3D data of forensic scans. Jim Drury saw it in operation.
Video provided by Reuters

Related Stories

Oct. 1, 2013 — Older and younger people have varying preferences about what they would want a personal robot to look like. And they change their minds based on what the robot is supposed to ... full story

Sep. 12, 2013 — Designers of social robots, take note. Bring your dog to the lab next time you test a prototype, and watch how your pet interacts with it. You might just learn a thing or two that could help you ... full story

Mar. 3, 2010 — Researchers surveyed more than 5,000 participants in a national Internet matchmaking service to determine what kinds of people are most likely to lie during the online dating ... full story

ScienceDaily features breaking news and videos about the latest discoveries in health, technology, the environment, and more -- from major news services and leading universities, scientific journals, and research organizations.