Prosody-based Gesture Recognition

Getting robots and computers to understand human communication is more
complex than just recognizing words. A Technology
Research News story describes work being done at Pennsylvania State
University to build a computer interface that understands humans by
analyzing the relationship between prosody and gestures. For more detail
on the subject, a paper
(PDF format) by the researchers is available online.