Homepage

BINAUDIO is a project that will involve several realities in the field of the realization of 3d sound and acoustic engineering companies in order to create instruments applied to immersive audio.The project is still under design but we assure you it will be innovative and above every expectation.

Listen to a Picture

Listen to a picture

We’re partecipating with this project at ERRIN European Regions Research and Innovations Network

Short description of project idea :

We want to transform a “visual picture” in a “audio picture” with binaural audio. So bling people can partecipate an exibition of paintings. They can’t see the picture, but they can listen the picture. Binaural audio is the way to open the canvas and transform it in “audio”: voice of people, nature, animals. all the elements of the picture can be animated and described the canvas through a dive inside the canvas. the user will have audio input in the four directions. At the base of the work there will be a cultural historical research of the environment represented and a engineering research to realize the final app.

Description:

objectives: realize an app so blind people can visit a museum or an exibition of picture. First step to analize engineering need, it was developed. Second step to try binaural audio on video project to undestand limits and success point, was developed. Next steps are: to develope dedicated ear phone, to develope dedicate app, to make an inventory of the main paintings in the museums that can be transformed into audio files. last step, choose a picture to use as a test.

Challenges that may determine the impact of the project:

first challenge to have a support from director of museum to have all information about one historical picture, and to have all permission to study it. the main challenge will be to find funding to create a database of cadres in the app and allow the app to be free for the blind

Partners that have already expressed interest in the project and expected

DAMS of Gorizia: study and match the position of the frame elements of picutre, in the four directions in binaural process and to partecipate to realize file 3D audio – final output University of Udine: to study and to realize 3D audio file

– public: museum or art gallery. they can provide historical material about the artist and to the exposed picture. – private engineerign lab: to project and to releazie a prototipe of small and comfortable headphone for binaural audio. On the market there are headphones for binaural, but they are large and uncomplicated.

Specific countries/regions/cities you are keen to collaborate with:

Trieste/ Gorizia/Udine in Friuli Venezia Giulia

First Name: Debora

Last Name: Desio

Name of the organisation

A_LAB Srls

Binaural

What is binaural audio?

Binaural recordings are reproductions of sound the way human ears hear it. In fact, the word “binaural” literally just means “using both ears.” When you listen to a binaural recording through headphones, you perceive distinct and genuine 360° sound.

It’s the purest, most natural way to record and listen to music.

Now, almost a century after the demise of the Theatrophones, investors are starting to revisit 3D audio technology: the prototype of Sony’s VR headset Project Morpheus includes a custom 3D audio binaural solution in its development kit. “3D audio adds to the feeling of presence that we strive so hard to achieve with the visuals in VR,” says Richard Marks, senior director of research and development at Sony Computer Entertainment America. “When sound is perceived to come from the same direction as a visual stimulus, the credibility of the virtual experience is greatly increased. While purely visual VR experiences can be made, adding 3D audio greatly magnifies the impact and depth of a VR experience.”

3D audio offers a more expansive experience than its visual counterpart. “Unlike with the visuals, 3D audio is not limited to the field of view of the display and can be rendered to give a ‘complete 360-degree’ experience,” says Marks. “One of the biggest challenges for VR design is that the user can look in any direction, and may not even be looking when something momentous occurs. But using a 3D audio cue, it is possible to steer the user’s attention to look in the direction of the sound, similar to techniques that are used in live theater.”

Project

We working with Protools HD12 with Dolby Atmos production suite ,Audio Ease 360 pan suite and NX waves plug-in.

Tools for Dolby Atmos in VR

Dolby Atmos Panner Plug-in for Pro Tools

Lets you place audio objects in 3D space and generates object metadata that is authored with the final content

Renderer

Takes the audio and metadata from Pro Tools®, and creates the mix in the Dolby Atmos® environment, returning a binaurally rendered mix that is encoded into standard Dolby Digital Plus™ format

Monitor Application

Provides signal metering and a dynamic view of all mix objects, so you can see where each object is placed in the 3D space

Video Player

Plays in sync with Pro Tools and allows you to view equirectangular or 3D video on an Oculus® headset, while sending positional data back to the renderer, so you can hear the effects of head tracking in real time

audioease 360 pan suite

There are a lot of names for the type video that the 360pan suite can deliver spatial (or localized, immersive, 3D) audio for:

360° video

VR video

Virtual Reality video

Panoramic video

Spherical video

to name the most common.
These type videos require a soundtrack that can turn when the head of the viewer with VR goggles on, or his phone, is turned.

There are a number of playback platforms for 360 VR videos.

Facebook 360

Oculus Video

YouTube

SamsungVR

Jaunt

to name a couple.

All of these chose Ambisonics as the technology that allows for the interactively turning audio mix. This means that audio-post folks need to produce ambisonics mixes. Ambisonics mixes are in a format called b-format, which consist of four channels. B-format comes in two channel orders: AmbiX or FuMa.
YouTube requires AmbiX b-format ambisonics soundtracks, so this is what 360pan delivers.
Facebook requires 2nd order ambisonics, 360pan suite 2 also delivers this.

Waves NX

Waves Nx finally bridges the gap between monitoring on speakers and monitoring on headphones. By letting you hear the depth and stereo spread you would be hearing on external monitors, Nx gives you an accurate representation of how your headphone mix will translate to loudspeakers. By delivering the natural listening experience of a physical room, Waves Nx also makes the headphone experience more comfortable and ear-friendly over long periods of time.

Want to mix for 7.1, 5.1 or 5.0 surround on your regular stereo headphones? Waves Nx lets you do exactly that – a true revolution in the world of surround mixing.

Best of all: Waves Nx does all this without coloring your sound. What you hear is your mix, exactly the way you want it to sound – only now you have a more accurate way to monitor it on headphones.

Use Waves Nx with real-time head tracking – taking advantage of your computer’s camera or the Nx Head Tracker – and enjoy the enhanced realism of being in the Virtual Mix Room, anywhere and everywhere you go.