Abstract

Virtual musical instruments (VMIs) are Augmented Reality (AR) or Virtual Reality (VR) based applications that focus on the interaction with real or virtual musical objects through AR or VR mediums. For such purpose, different interaction tools and techniques such as fiducial markers, RGB and depth cameras, VR and AR headsets are used. Though modern AR and VR devices provide better interaction interfaces, they are more expensive than traditional ones that are unfortunately not robust as the modern devices. To provide a robust and affordable AR and VR interaction interface for real-time applications, we investigate the use of affordable body-worn inertial measurement unit (IMU), a web camera, an RGB light as a simple, cheaper and reliable solution for the interaction with virtual percussion instruments. The performance of the proposed system was evaluated through a series of feedback from fifteen users. In general, the framework was considered as intuitive and tangible.

Jordà, S.: Interactive music systems for everyone: exploring visual feedback as a way for creating more intuitive, efficient and learnable instruments. In: Proceedings of the Stockholm Music Acoustics Conference, pp. 6–9, August 2003Google Scholar