Muse - Graphical Sound

iOS APP | MASTER'S PROJECT | 2018

This is an app that is being worked on as a part of my Master’s research on visual music. For the past two years, I have been working on various ways to find different relationships between music and visuals. During the most part of my research the aim was to visualise music through different mediums, but this is a completely different approach, where I’m trying to convert an image into a soundtrack. This process is generally known as graphical sound or drawn sound.

The app captures an image through the camera or through the camera roll and reads through all the pixel values and converts those pixel values into greyscale. Then the corresponding greyscale value is given a computer-generated sound notation and makes it synchronised through delays. So different images will ‘sound’ different.

This is a work-in-progress app and I’m working with a Swift programmer from HVL (Høgskolen På Vestlandet, Bergen) to bring this app to life.