Fujitsu Laboratories has developed a next generation user interface which can accurately detect the users finger and what it is touching, creating an interactive touchscreen-like system, using objects in the real word.

They think paper and many other objects could be manipulated by touching them, as with a touchscreen. This system doesn’t use any special hardware, instead it consists of just a device like an ordinary webcam, plus a commercial projector. Its capabilities are achieved by image processing technology. Using this technology, information can be imported from a document as data, by selecting the necessary parts with your finger.