#EUsavesLives Roadshow: Humanitarian Operations with Spatial Audio Workstation

The #EUsavesLives VR experience, developed for the European Commission, aims to vividly show citizens how the EU helps in crises worldwide.

This article details the technology and its application. For this project, I traveled for DG ECHO (Humanitarian Aid and Civil Protection) to Belgium, Denmark, and Bangladesh to create immersive 360° footage, later incorporated into a VR app for the roadshow.

The team will continue supporting external downloads of the Audio360 Encoder application, ensuring ongoing access to this tool for preparing 360 videos for platforms like Facebook.

Introduction to Spatial Audio in Humanitarian Operations

Spatial audio is a groundbreaking technology that captures the “where” of sound, transcending the traditional limits of two-channel stereo recordings.

By creating a three-dimensional soundscape, spatial audio allows listeners to perceive the direction and distance of audio sources, making it an invaluable tool in various fields, including humanitarian operations.

In the realm of humanitarian efforts, spatial audio can be used to create immersive experiences that simulate real-world environments. This capability is particularly beneficial for training and preparedness exercises for emergency responders.

By placing trainees in a virtual environment with realistic soundscapes, spatial audio enhances situational awareness and response effectiveness.

Moreover, spatial audio can be leveraged to develop engaging and interactive educational content for humanitarian organizations. This approach not only improves knowledge retention but also facilitates the transfer of critical information in a more impactful manner.

For instance, spatial audio can recreate the sounds of a disaster zone, helping aid workers and volunteers better understand the challenges they might face.

Implementing spatial audio in humanitarian operations requires specialized equipment and software. Digital audio workstations (DAWs) and spatial audio plugins are essential tools for capturing, editing, and mixing spatial audio content.

One notable software suite is the Facebook 360 Spatial Workstation, designed for creating spatial audio for 360 video and cinematic VR. This tool can be effectively applied to humanitarian operations, providing a robust platform for designing immersive audio experiences.

What is Spatial Audio?

Spatial audio allows soundscapes to be created, drawing audiences deeply into virtual experiences. This technology is used across multiple fields—from large-scale sound installations like the Sphere in Las Vegas to music production. 3D audio offers advantages like immersive sound experiences in music, theater, and film.

In art installations and VR projects, music plays a crucial role in spatial audio design. Spatial Audio Designer, for example, allows for precise placement of sound sources, creating a natural audio space that simulates realistic, immersive environments.

Unlike Dolby Atmos, which is primarily used in film production and not ideal for 360° videos, and MPEG-H, which is commonly used in broadcasting, spatial audio is perfectly suited to create dynamic, authentic soundscapes in VR.

The Technology Behind Spatial Audio

Spatial audio technology enables the creation and playback of audio content in a three-dimensional space. It leverages human hearing’s ability to locate sounds to create realistic, immersive experiences. At its core, spatial audio involves audio objects positioned in space to form a three-dimensional sound landscape.

Logic Pro integrates with Dolby Atmos, enabling users to effectively place audio elements in a three-dimensional space while mixing.

A key tool here is Spatial Audio Designer by New Audio Technology. This powerful tool provides an intuitive interface for audio designers to position objects and adjust their attributes in space.

Supporting formats like MPEG-H and Dolby Atmos, Spatial Audio Designer enables the creation of highly detailed, immersive soundscapes. Its flexibility makes it an indispensable tool in modern audio production.

Creating and Mixing Spatial Audio

Creating spatial audio involves capturing and recording audio in a manner that preserves the spatial relationships between sound sources. This process begins with the use of specialized microphones and recording techniques that can accurately capture the direction and distance of sounds.

The goal is to create a realistic audio environment that mirrors how we perceive sound in the real world.

The mixing process for spatial audio is equally intricate and requires specialized software and plugins. The Dolby Atmos Production Suite, for example, is a powerful tool used to create and mix spatial audio content.

This software allows audio engineers to place audio sources in a virtual 3D space, using techniques such as panning and depth placement to achieve a lifelike soundscape.

Spatial audio mixes can be created using various audio formats, including ambisonic and binaural audio. Ambisonic audio captures the full sphere of sound around the listener, while binaural audio uses two channels to simulate the way human ears perceive sound.

Both formats contribute to the overall immersive experience, making the audio content more engaging and realistic.

The use of spatial audio in mixing and post-production significantly enhances the immersive experience of audio content. By carefully positioning audio sources and adjusting their attributes, audio engineers can create a dynamic and interactive sound environment.

This approach not only enriches the listener’s experience but also adds depth and realism to the audio content.

The #EUsavesLives Roadshow – Applying Spatial Audio in VR

The #EUsavesLives roadshow aimed to raise awareness of the EU’s operations in crisis zones. Realistic 360° footage was combined with spatial audio to place viewers acoustically at EU deployment sites in Belgium, Denmark, and Bangladesh.

Reliable monitoring systems played a crucial role in effectively overseeing and adjusting audio content throughout the roadshow. Spatial mixes were used to blend various audio formats, enhancing the immersive experience for viewers.

• Belgium (ERCC, Brussels): Here, immersive sound recreated the busy atmosphere in the Emergency Response Coordination Centre, the EU’s crisis command center. Viewers heard instructions and communication between responders, experiencing decision-making firsthand.

• Denmark: The audio execution of the earthquake drill in Denmark required highly realistic, dynamic sound recordings to convey the urgency of response teams in an emergency. With spatial audio, we gave visitors the feeling of being in the middle of simulated rescue efforts.

• Bangladesh: The extreme conditions in the Rohingya refugee camp posed unique challenges, addressed by a thoughtful combination of object-based audio and authentic ambient sounds. The audio transported the camp’s atmosphere, allowing visitors to perceive everyday noises from various directions, enhancing the camp’s immersive reality.

Technical Challenges and the Role of VRTonung

The production was both logistically and technically challenging. Thanks to my expertise in stereoscopic 360° videos and VR experiences, I was able to overcome these challenges.

Filming required high flexibility; using the Kandao Obsidian camera and robust spatial microphones allowed me to capture the complex soundscapes on location. Integrating multiple audio technologies was critical to achieving a seamless, immersive audio experience. But the challenges didn’t stop with filming.

Post-production was an elaborate process. Since the VR experience was available in seven languages, the sound design had to be adapted individually for each version. Combining these languages into a consistent, immersive sound environment required precision work and careful sound mixing.

Digital audio workstations were essential in creating and editing the audio content, particularly for Dolby Atmos integration. Spatial and object-based audio elements needed to maintain their immersive impact regardless of language, and synchronizing audio tracks demanded extreme accuracy.

Using spatial audio workstations like Two Big Ears and Spatial Audio Designer from New Audio Technology, I successfully achieved seamless multilingual interactivity. Support for these technologies will continue for the foreseeable future, ensuring ongoing access and updates.

Essential Tools and Formats for Spatial Audio

Various tools and techniques were used to create an acoustically immersive experience:

• Two Big Ears: This platform proved ideal for the immersive audio experience in VR, designed for 360° soundscapes in video and VR applications. Presonus recently updated their Digital Audio Workstation Studio One (version 6.6), enhancing functionality, particularly for Dolby Atmos and Apple Spatial Audio, and introducing a new software synthesizer called Lead Architect.

• Spatial Audio Designer (SAD): A powerful plug-in from New Audio Technology, SAD enabled precise spatial positioning of sound sources, allowing for an authentic representation of each scene in the crisis areas.

• Pro Tools and Ableton Live: Supported by specific spatial audio plug-ins, these DAWs were essential for the complex, multi-channel sound mixes that intensified the #EUsavesLives roadshow’s immersive experience. The latest versions support Dolby Atmos, Apple Spatial Audio, and specific audio applications. Additionally, new digital release options allow for direct music publishing on social media and streaming platforms via TuneCore.

• Professional Studios: Using and adapting virtual studio spaces is essential for creating binaural and immersive audio experiences, highlighting the importance of professional studios for creative audio production. Despite the discontinuation of the Audio360 suite, users can still access the essential Audio360 Encoder application through external downloads, ensuring they have the necessary tools for creating 360 videos.

The acoustic rendering of crisis scenarios showed how powerful and nuanced spatial audio can be, bringing the emotional depth of an event closer to listeners.

Distributing and Sharing Spatial Audio Content

Distributing and sharing spatial audio content requires specialized platforms and tools to ensure the immersive experience is preserved across different devices and media. The Facebook 360 Spatial Workstation is one such tool, designed to facilitate the creation and distribution of spatial audio for 360 video and VR applications.

Spatial audio content can be shared on social media platforms, such as the Facebook News Feed, allowing a wide audience to experience the immersive soundscapes. These platforms support various devices, including VR headsets and mobile devices, making spatial audio accessible to users in different environments.

The use of spatial audio in content creation enhances engagement and interaction with audio content. By providing a more immersive and realistic audio experience, spatial audio captures the listener’s attention and improves the overall user experience.

This technology is particularly effective in applications such as education, training, and entertainment, where an engaging audio environment can significantly impact the effectiveness of the content.

Looking ahead, the future of spatial audio distribution and sharing will likely involve the development of new platforms and tools that support the creation and sharing of immersive audio content.

As technology continues to evolve, we can expect more innovative solutions that will make spatial audio an integral part of various media and applications, further enhancing the way we experience sound.

The Future of Spatial Audio in Humanitarian Operations

Spatial audio has a promising future in humanitarian operations. This technology can be used in fields such as disaster relief, healthcare, and education to create immersive, realistic audio content that helps listeners better understand complex information and empathize with a situation.

A powerful example is spatial audio in disaster response. This technology enables aid workers to create immersive audio content that highlights the plight of disaster victims, helping them understand critical information.

By spatially positioning emergency services and aid organizations in the sound field and adjusting their acoustic attributes, a realistic soundscape is created, offering orientation and support to affected people.

In sum, spatial audio offers numerous opportunities for creating immersive and realistic audio content across various fields. The future of spatial audio in humanitarian operations looks promising, allowing listeners to immerse themselves in the events and better understand complex information.

Conclusion: VRTonung – The Expert in Immersive 360° Sound Production

The #EUsavesLives project demonstrates spatial audio’s power as a storytelling tool and its role in immersive VR experiences. Audio technology companies play a vital role in developing and providing spatial audio technology.

As an expert in stereoscopic 360° videos and immersive VR experiences, I was able to meet the EU roadshow’s complex requirements and create a deep emotional connection with the audience through spatial audio. With precise sound design and specialized technologies, the VR experience vividly communicated the EU’s humanitarian aid efforts.

This project exemplifies spatial audio’s future in VR applications, showcasing how combining 360° video and immersive sound creates a lasting, memorable experience far beyond traditional audiovisual storytelling.