Detection and Tracking of Faces in 3D Using a Stereo Camera Arrangements

Faleh AlQahtani, Jasmine Banks, Vinod Chandran, and Jinglan Zhang

Abstract—3D facial tracking has become vital to the
continued integration of computers, technology, and human
society. In recent decades, the integration of technology has
increased, and the use of surveillance, conference calls, gaming
components, and other similar applications has spurred
demand for the ability to recognize the distinctive features of
humans. However, in order for these new technologies to
function effectively and reach their fullest potential, a great deal
of work is still needed. The field of facial mapping and tracking
is still in its early developmental stages, necessitating additional
research into the best methods of tracking and monitoring
specific human faces. To this end, an algorithm has been
created that would allow for improvements in this area;
however, a video was first required that could be used
effectively for the algorithm. Two web cameras running on
Raspberry Pi were used to gather the footage necessary for
detecting and tracking specific facial features. While certain
limitations were identified throughout the process, the
algorithm still achieved significant successful tracking results.
In spite of this success, further efforts are still needed to
effectively explore the proposed algorithm and improve upon
these initial results.