MSARemote for iPhone (2009)

Controlling Java/processing.org fluid simulation with TUIO

Controlling VDMX & Ableton Live simultaneously

In this video, OSCulator is routing the OSC (& TUIO) messages coming from MSA Remote to midi and forwarding to Ableton Live (for audio) and VDMX (for visuals) simultaneously. Nothing is done in post, the same signal is controlling both audio and video. Video demonstrates faders, triggers, and velocity sensitive keys – yes velocity sensitive. The harder you hit the keys, the louder the sound (or whatever you want to map it to).

Controlling custom multitouch paint application with TUIO

Graffiti Wall is a product that Tangible Interaction had already developed a while ago. It was built on TUIO from the beginning, so when I passed on a copy of MSA Remote, they were able to immediately integrate it with their app without any modifications.

Max/MSP

MSA Remote is a remote control application for iPhone & iPod Touch that sends OSC messages over the wifi network. This allows you to control any OSC supporting applications such as Max/MSP/Jitter, PureData, Reaktor, VDMX, vvvv, Resolume, Quartz Composer etc. as well as any custom applications such as interactive installations, audio/visual performances, multitouch capable surfaces etc. It includes the widely used open standard TUIO for multitouch communications and custom specifications (detailed below) for faders, triggers and other controls. By mapping the OSC to midi on desktop (e.g. using OSCulator) allows further control of any application which supports midi such as Ableton Live, Cubase, Logic Pro, 3DSMax etc. In addition, developers can easily integrate OSC into their applications knowing it can be controlled remotely.

The application can be distributed to visitors, guests, members of the public etc. to interact with an installation or performance, or used by dedicated performers.

It was initially rejected by the Apple Store for being ‘useless’. However after a massive out-roar by the community, it was accepted.

Features:

- Multitouch information sent using standard TUIO protocol for instant integration with existing TUIO clients
- Accelerometer data for each axis (x, y, z) is sent
- 64 faders (8 pages of 8 faders)
- 64 triggers (8 pages of 8 triggers)
- 108 key (9 octaves) VELOCITY SENSITIVE polyphonic keyboard. Yes, the harder you hit the keys, the greater the velocity.
- Settings are automatically saved and restored
- Multitouch area orientation can be set as desired
- All information on protocols are documented in the app

Credits

Designed and developed by Mehmet Akten
Illustrations by Jane Laurie - janelaurie.com