We explore the use of ubiquitous sensing in the home for context-sensitive microlearning. To assess how users would respond to frequent and brief learning interactions tied to context, a sensor-triggered mobile phone application was developed, with foreign language vocabulary as the learning domain. A married couple used the system in a home environment, during the course of everyday activities, for a four-week study period. Built-in and stick-on multi-modal sensors detected the participants’ interactions with hundreds of objects, furniture, and appliances. Sensor activations triggered the audio presentation of English and Spanish phrases associated with object use. Phrases were presented on average 57 times an hour; this intense interaction was found to be acceptable even after extended use. Based on interview feedback, we consider design attributes that may have reduced the interruption burden and helped sustain user interest, and which may be applicable to other context-sensitive, always-on systems.

This work was supported by Intel Corporation. We thank our participants for the generous contribution of their time and feedback, and TIAX LLC for collaboration on the PlaceLab. The sensors used were developed with support from National Science Foundation grant #0313065. The PlaceLab stay was funded by Microsoft Research.