OmniTouch, a wearable projection system developed by researchers, enables users to turn pads of paper, walls or even their own hands, arms and legs into graphical, interactive surfaces. OmniTouch employs a depth-sensing camera to track the user's fingers on everyday surfaces. This allows users to control interactive applications by tapping or dragging their fingers, much as they would with touchscreens found on smartphones or tablet computers.

OmniTouch, a wearable projection system developed by researchers at Microsoft Research and Carnegie Mellon University, enables users to turn pads of paper, walls or even their own hands, arms and legs into graphical, interactive surfaces.

Related Articles

OmniTouch employs a depth-sensing camera, similar to the Microsoft Kinect, to track the user's fingers on everyday surfaces. This allows users to control interactive applications by tapping or dragging their fingers, much as they would with touchscreens found on smartphones or tablet computers. The projector can superimpose keyboards, keypads and other controls onto any surface, automatically adjusting for the surface's shape and orientation to minimize distortion of the projected images.

"It's conceivable that anything you can do on today's mobile devices, you will be able to do on your hand using OmniTouch," said Chris Harrison, a Ph.D. student in Carnegie Mellon's Human-Computer Interaction Institute. The palm of the hand could be used as a phone keypad, or as a tablet for jotting down brief notes. Maps projected onto a wall could be panned and zoomed with the same finger motions that work with a conventional multitouch screen.

Harrison was an intern at Microsoft Research when he developed OmniTouch in collaboration with Microsoft Research's Hrvoje Benko and Andrew D. Wilson. Harrison will describe the technology Oct. 19 at the Association for Computing Machinery's Symposium on User Interface Software and Technology (UIST) in Santa Barbara, Calif.

The OmniTouch device includes a short-range depth camera and laser pico-projector and is mounted on a user's shoulder. But Harrison said the device ultimately could be the size of a deck of cards, or even a matchbox, so that it could fit in a pocket, be easily wearable, or be integrated into future handheld devices.

"With OmniTouch, we wanted to capitalize on the tremendous surface area the real world provides," said Benko, a researcher in Microsoft Research's Adaptive Systems and Interaction group. "We see this work as an evolutionary step in a larger effort at Microsoft Research to investigate the unconventional use of touch and gesture in devices to extend our vision of ubiquitous computing even further. Being able to collaborate openly with academics and researchers like Chris on such work is critical to our organization's ability to do great research -- and to advancing the state of the art of computer user interfaces in general."

Harrison previously worked with Microsoft Research to develop Skinput, a technology that used bioacoustic sensors to detect finger taps on a person's hands or forearm. Skinput thus enabled users to control smartphones or other compact computing devices.

The optical sensing used in OmniTouch, by contrast, allows a wide range of interactions, similar to the capabilities of a computer mouse or touchscreen. It can track three-dimensional motion on the hand or other commonplace surfaces, and can sense whether fingers are "clicked" or hovering. What's more, OmniTouch does not require calibration -- users can simply wear the device and immediately use its features. No instrumentation of the environment is needed; only the wearable device is needed.

More From ScienceDaily

More Computers & Math News

Featured Research

Mar. 3, 2015 — By examining the forces that the segments of mosquito legs generate against a water surface, researchers have unraveled the mechanical logic that allows the mosquitoes to walk on water, which may ... full story

Mar. 3, 2015 — Major cities in the UK are falling behind their international counterparts in terms of their use of smart technologies, according to a new study. The research has found that smart cities in the UK, ... full story

Mar. 3, 2015 — To simulate chimp behavior, scientists created a computer model based on equations normally used to describe the movement of atoms and molecules in a confined space. An interdisciplinary research ... full story

Mar. 3, 2015 — Magnetic vortex structures, so-called skyrmions, could in future store and process information very efficiently. They could also be the basis for high-frequency components. For the first time, a team ... full story

Mar. 2, 2015 — A method for analyzing and predicting nature's dynamic and interconnected systems has improved forecasts of populations of Fraser River Sockeye Salmon, a highly prized fishery in British Columbia, ... full story

Mar. 2, 2015 — The odds of picking a perfect bracket for the NCAA men's basketball March Madness championship tournament are a staggering less than one in 9.2 quintillion (that's 9,223,372,036,854,775,808), ... full story

Mar. 2, 2015 — Scientists report that they could observe experimentally the current flow along channels at the crystal surfaces of topological insulators. The channels are less than one nanometer wide and extend ... full story

Mar. 2, 2015 — Organic light emitting diodes (OLEDs), which are made from carbon-containing materials, have the potential to revolutionize future display technologies, making low-power displays so thin they'll wrap ... full story

Mar. 2, 2015 — What if one day, your computer, TV or smart phone could process data with light waves instead of an electrical current, making those devices faster, cheaper and more sustainable through less heat and ... full story

Mar. 2, 2015 — 3-D printing could become a powerful tool in customizing interventional radiology treatments to individual patient needs, with clinicians having the ability to construct devices to a specific size ... full story

Featured Videos

Forensic Holodeck Creates 3D Crime Scenes

Reuters - Innovations Video Online (Mar. 3, 2015) — A holodeck is no longer the preserve of TV sci-fi classic Star Trek, thanks to researchers from the Institute of Forensic Medicine Zurich, who have created what they say is the first system in the world to visualise the 3D data of forensic scans. Jim Drury saw it in operation.
Video provided by Reuters

Related Stories

Apr. 16, 2014 — Have you ever wished you had a virtual time machine that could show you how your street looked last century? Or have you wanted to see how your new furniture might look, before you’ve even bought ... full story

Oct. 7, 2013 — A system that allows users to experience multi-point haptic feedback above an interactive surface without having to touch or hold any device will be unveiled at a conference for innovations in ... full story

Apr. 25, 2013 — Researchers previously have shown that a depth camera system, such as Kinect, can be combined with a projector to turn almost any surface into a touchscreen. Now researchers have demonstrated how ... full story

Oct. 9, 2012 — People can let their fingers -- and hands -- do the talking with a new touch-activated system that projects onto walls and other surfaces and allows users to interact with their environment and each ... full story

July 21, 2010 — Touch screens such as those found on the iPhone or iPad are the latest form of technology allowing interaction with smart phones, computers and other devices. However, scientists in Germany have ... full story

ScienceDaily features breaking news and videos about the latest discoveries in health, technology, the environment, and more -- from major news services and leading universities, scientific journals, and research organizations.