Journal of Learning Analytics

Home >
Vol 4, No 3 (2017) > A Measurement Model of Gestures in an Embodied Learning Environment: Accounting for Temporal Dependencies

A Measurement Model of Gestures in an Embodied Learning Environment: Accounting for Temporal Dependencies

Alejandro
Andrade

Joshua
A.
Danish

Adam
V.
Maltese

Abstract

Interactive learning environments with body-centric technologies lie at the intersection of the design of embodied learning activities and multimodal learning analytics. Sensing technologies can generate large amounts of fine-grained data automatically captured from student movements. Researchers can use these fine-grained data to create a high-resolution picture of the activity that takes place during these student–computer interactions and explore whether the sequence of movements has an effect on learning. We present a use-case modelling of temporal data in an interactive learning environment with hand gestures, and discuss some validity threats if temporal dependencies are not accounted for. In particular, we assess how, if ignored, the temporal dependencies in the measurement of hand gestures might affect the goodness of fit of the statistical model and would affect the measurement of the similarity between elicited and enacted movement. Our findings show that accounting for temporality is crucial for finding a meaningful fit to the data. In using temporal analytics, we are able to create a high-resolution picture of how sensorimotor coordination correlates with learning gains in our learning system.

Full Text:

References

Abrahamson, D. (2014). Building educational activities for understanding: an elaboration on the embodied-design framework and its epistemic grounds. International Journal of Child-Computer Interaction, 2(1), 1-16.

Lindgren, R. (2015). Getting into the cue: Embracing technology-facilitated body movements as a starting point for learning. In V. Lee (Ed.), Learning technologies and the body: Integration and implementation in formal and informal learning environments (pp. 39-54). New York: Routledge.