Gest is here to kill the keyboard and mouse

Being hands-off usually means relinquishing control. With Gest, it’s the exact opposite.

RememberTony Stark in his lab in Iron Man, browsing through a massive amount of data with a literal swipe of his hand? That’s the type of control that Gest, a minimalist wearable hand tracker, wants to bring to your computer. (Presumably you don’t have a holographic display that fills the room of your private lab.)

Gest, developed by startup Apotact Labs, doesn’t look like much; its four wires with adjustable finger bands hang out from a plain black strap that wraps around the palm. But what it enables, thanks to the combination of accelerometers, gyroscopes, and magnetometers, is touchless control that would otherwise require a mouse or keyboard.

Apotact Labs CEO and co-founder Mike Pfister told the Daily Dot that the idea for Gest was born out of the frustration he felt trying to use tiny onscreen keyboards.

“The keyboard and mouse are starting to make less sense as our devices get smaller,” Pfister said. “We need a fundamentally new input method to control these devicessomething that gets back to the basics as how we interact as humans. Thats why we created Gest.”

Pfister’s team built the first prototype for Gest overnight during a hackathon nearly two years ago. It underwent significant redesigns and is now seeking $100,000 in funding on Kickstarter.

By far the most intriguing application of Gest is air typingthe ability to type with no keyboard.

It’s still an experimental feature at this point, and it appears from the demonstration that it relies on predictive text, like most smartphone keyboards, to correct for any inaccuracies. Being able to call on this feature anywhere would be a boon to mobile device users. It would also offer an input method for virtual reality that wouldn’t ruin the immersion.

Unlike a true motion tracker like Leap Motion or even the XboxKinect, Gest isn’t tracking exact motions. It’s producing actions based on input the same way double-clicking the mouse or typing the “D” key produces a given action. It’s just getting those commands from hand movements.

While this distinction provides considerable benefits for the deviceit’s portable, the battery lasts longer, and it can connect to basically any device that supports Bluetooth Low Energyit also represents an adoption hurdle. Gest won’t work with software that doesn’t contain special support for it.

When Gest launchesthe current target date is November 2016it will offer support for Photoshop. Pfister said that his team is “focused on building a really great experience with Photoshop using Adobes SDK ,” but he isn’t working directly with Adobe right now.

Apotact Labs has already opened up the Gest development kit with the hope of encouraging developers to build new applications, integrations, and use cases for the gesture control system. The company will also offer developers access to raw sensor data and custom skeletal models, as well as motion-processed data, in order to give them more information to inform their work and creations.

“We dont need to work directly with developers,” Pfister explained. “Its important to us that we give them the room to create and contribute on their own. We value that greatly.”

Gest is already well on its way to meeting its fundraising goal. Early-bird backers can score Gest for a $99 pledge. That’s just for one hand, though. When Gest eventually hits the market, it will retail for $200 per hand.