Teaching

Lost Key Scenario

A pro-active mobile robot builds up a situation model of its environment. It observes actions by human interlocutors and understands their verbal descriptions. This representation is later used to verbalize the location of arbitrary objects in a human-like manner.

This scenario includes the need for a structural understanding of the physical surrounding of the robot. The identification of furniture items is key for grounding and verbalizing descriptions that relate objects to furniture. A robust segmentation of relevant foreground objects is needed to reduce the search space and complexity of the spatial representation of the environment. The robot implements a pro-active behavior that includes intelligent positioning in order to be able to observe the human's actions.