Automatic Non-Rigid Movement Reconstruction and Analysis

Development of non intrusive communication technologies for research and applications

Rich face models already have a large impact on the fields of computer vision, non intrusive behavior monitoring, perception research, as well as computer graphics and animation. Attributes such as descriptiveness, semantics, and intuitive control are desirable properties but are hard to achieve. Towards the goal of building such high-quality face models, we present a 3D model-based analysis-by-synthesis approach that is able to parameterize 3D point clouds, and that can estimate the state of semantically meaningful components, even from noisy depth data such as that produced by Time-of-Flight (ToF) cameras or devices such as Microsoft Kinect.