Lincoln Repository

The use of synchrony in parent-child interaction can be measured on a signal-level

Rolf, Matthias and Hanheide, Marc and Rohlfing, Katharina J.
(2009)
The use of synchrony in parent-child interaction can be measured on a signal-level.
In: SRCD 2009 Biennial Meeting, April 2-4 2009, Denver, Colorado.

Abstract

In our approach, we aim at an objective measurement ofsynchrony in multimodal tutoring behavior. The use of signalcorrelation provides a well formalized method that yieldsgradual information about the degree of synchrony. For ouranalysis, we used and extended an algorithm proposed byHershey & Movellan (2000) that correlates single-pixelvalues of a video signal with the loudness of thecorresponding audio track over time. The results of all pixels are integrated over the video to achieve a scalar estimate of synchrony.

Additional Information:

In our approach, we aim at an objective measurement of
synchrony in multimodal tutoring behavior. The use of signal
correlation provides a well formalized method that yields
gradual information about the degree of synchrony. For our
analysis, we used and extended an algorithm proposed by
Hershey & Movellan (2000) that correlates single-pixel
values of a video signal with the loudness of the
corresponding audio track over time. The results of all pixels are integrated over the video to achieve a scalar estimate of synchrony.