Research & Scholarly Achievement
at Gallaudet University

ML2: Object Oriented Hand Classifier Recognition with LEAP and Unity

ID:

3499

Status:

Ongoing

Start date:

February

2017

Description

We are investigating sign recognition interfaces to utilize interactivity in learning. LEAP Motion is a motion sensor system that tracks the hands and implements in 3D environments. Our goal is to utilize LEAP Motion to identify parameters of different ASL handshapes that are object-specific classifiers. The purpose of this project is to create an immersive game experience, where young deaf learners will learn the correct handshapes and movements to guide the object. Through this project, we want to understand the integration of LEAP Motion and Unity (game engine) to better define sign/movement recognition that can contribute to language learning programs.