ABSTRACT This paper describes a prototype retail environment in which information interactions occur in situ, within the actual space of the merchandise. By combining a steerable projected display and recognition of user gestures and actions, and user position tracking through peripheral cameras, we have developed several innovative interaction techniques designed to augment the reality of a retail store.