Spatial 3D Audio Apps – Apple Airpods Pro, Galaxy Buds Head tracking

Since the establishment of VR glasses as serious playback devices in the entertainment industry, head tracking technology has found a wide range of applications. In today’s tech-savvy world, 3D spatial audio apps are revolutionizing the way we perceive and hear sound, creating a truly immersive audio experience.”

The potential of 360° sound is far from exhausted, and recent developments in the field of spatial audio showcase its capabilities. Spatial audio technology has come a long way, and these apps are at the forefront, supporting dynamic head tracking and bringing audio to life like never before.

With the introduction of head tracking enabled headphones and pods, the two big players Apple and Samsung are taking a giant step towards establishing 3D audio in the consumer market – out of its niche existence.

The following article will give an overview of the currently most important and popular apps for the playback of spatial audio via handheld devices such as smartphones and tablets.

Update

• 21/04: M1 MNTR CTRL (Mach1 Spatial) has been added to the list of apps for Apple Airpods Pro and Bose AR.
• 21/06: Sony WF-1000XM4 true wireless headphones for 360 audio reality added.
• 21/08: Netflix now supports Spatial Audio with Airpods Pro for Apple
• 22/01: Article extended into article about AR 3D Audio Headphones and dynamic head-trackers
• 23/03: Immersive Audio Experience “Ammersive” added. Aswell as Portal – Immersive Escapes to the apps supporting spatial audio on Airpods

Headphones with tracking like a VR headset

First of all, I think it’s important to lay out the basic way these applications for using spatial audio work. Not just from a technological perspective, but from a conceptual one. This is to prevent the ‘wrong’ use of this technology and accompanying disappointments.

Also, the terminology surrounding immersive audio technology is currently being thrown around wildly. Apple talks about 3D spatial audio with dynamic head tracking. Samsung talks about a 360 audio function with an intelligent motion-tracking sensor. Bose AR even talked about Augmented Audio Reality (ARR) back then.

But everyone is ultimately talking about immersive, cinema-like surround sound that detects the direction of the headphones’ gaze. A spoiler directly related to the topic of movies: the manufacturers currently activate the function almost exclusively in combination with moving images.

However, there are great applications that also work without pictures, for example 3D podcasts and audio plays. Or immersive 3d music with Dolby Atmos that I will talk about later.

Head tracking: the dynamic head movement

Dynamic head tracking is at the heart of spatial audio technology, ensuring that the audio follows your head movements, creating a truly immersive environment. In order for head tracking to work in terms of freedom of movement in a virtual sound scene, a reference point is needed.

Additionally to the audio device, this framework is provided by the smartphone or tablet. The headphones, therefore, know from the position of the playback device from which direction the sounds should come. Dynamic head tracking is a crucial element of spatial audio, allowing for an immersive audio experience that adapts to your movements.

But be careful, this does not mean that the sound only comes from the direction of the cell phone; as just mentioned, this only serves to calibrate the sound scene. This way you can make sure that, for example, sounds that should come from the left really do come from the left.

Technology is fun … when it works

The crucial aspect for using head tracked- said headphones is the software, i.e. the smartphone apps and the right operating system. Even if standard headphones are sufficient for a static, spatial 3D audio impression. For head tracking, it must be ensured that the corresponding apps also support spatial audio.

In the use case, these are mostly various streaming platforms. During my research, I had the feeling in some user reports that it is not always clear that there has to be compatibility here.

To avoid such discrepancies for the loyal reader of this blog, the following should provide a greater clarity about the hardware and software components. So that nothing stands in the way of a 3D audio experience.

Spatial Audio for Apple from the Appstore

Apple pioneered spatial audio with head tracking for handheld devices with the introduction of the AirPods Pro and AirPods Max. With these Apple devices, surround sound formats like 5.1 and 7.1, as well as Dolby Atmos, are supported.

However, this does not mean that every streaming provider that offers surround sound or Atmos is also compatible with Apple. The following video gives a short overview of the AirPods Pro. It gets interesting starting at 0:57:

Hardware and software requirements that support spatial audio

Apart from the streaming services, the hardware and operating system must also be right. In terms of hardware, you need an iPhone 7 or newer, or an iPad. Also, the operating system iOS 14 or iPadOS 14 is required, but how the technical requirements look in detail you can read here.

User Experience Apple 3D Audio

It’s always a bit difficult to describe how the sound sounds. Regardless, here a short conclusion from my perspective as a spatial audio engineer:

• The dynamic head detection works well and has an imperceptible latency. This is despite Bluetooth a positive surprise.
• The usability is very good. You know immediately from the icons whether the function is activated. There even is a small demo to get hooked. If an app supports head tracking, this is also visually reinforced. Samsung has to improve this, but more later.
• If 3D audio is enabled, the loudness is increased a bit. In addition, the sound is given an artificial room with even more reverb. This might be critical for the sound engineer, but good for the consumer.
• Although the AirPods Pro sit in the listening channel, the impression of envelopment seems successful. You have the feeling that the sound comes from outside the earphones. The so-called externalization is thus good.

Overview of compatible apps for AirPods Pro and AirPods Max

From AirPods Pro to AirPods Max, these apps are compatible with a wide range of devices, making it easier than ever to experience the benefits of spatial audio.

360 Audio for Samsung from Google Playstore

Shortly after Apple’s AirPods, Samsung sent the Galaxy Buds Pro into the race. They are using Dolby Head Tracking technology (TM). What is Spatial Audio for Apple is 360 Audio for Samsung – two terms for the same concept.

However, the devil is in the details. Currently, the Spatial Audio works automatically with every video. This means that even if the video only contains mono or stereo sound, the sound is artificially virtualized. Thus, you can hear the sound clearly directed from the cell phone.

But it’s not an immersive, enveloping sound like the Apple Airpods manage. So it doesn’t benefit from multi-channel surround – or 3D sound. Which is a pity that I feel like will be fixed in the future.

Of course, to take advantage of this innovative technology in the first place, the hardware and software have to be right. 360 Audio works on Samsung Galaxy phones and tablets with the latest One UI 3.1 operating system. How to listen to the 360 Audio function can be found here.

The feature was initially announced exclusively for new models like the Galaxy S21. However, shortly after, the new operating system was also rolled out for my S10 and I can now also listen to media in 360 audio.

Youtube, Facebook, LinkedIn, etc. support spatial audio technology?

As mentioned, the Galaxy Buds do not enable 3D audio in the sense of 360° sound. The general advantage of this approach is that sound virtualization works with all sound sources. Thus, the function is activated as soon as audio or video content is consumed on Facebook, LinkedIn, YouTube, or wherever.

For example, I was on my phone listening to a podcast and scrolling through social media. As soon as a video popped up in my news feed, the 360 audio automatically activated. Then I heard the podcast suddenly switching from stereo to spatial audio.

As well as the video that was then spatialized playing simultaneously. This is a good way to hear what the function does with media in the first place.

However, there is a good chance that this will be improved. Basically, the Galaxy Buds Pro have the same hardware like the Apple Airpods. The platforms also usually use Dolby Atmos or comparable multi-channel audio formats in the backend. So, we can be curious.

Apps with 3D audio but without head tracking spatial audio support

Although the focus of this article is on head tracking, a few more apps should be mentioned here that do not support these settings, but can still provide immersive listening experiences.

This is the soft entry into immersive 3D audio, for all standard stereo headphones. The sound here is binaural, accessible for everybody.

Headspace

This app offers guided meditations and mindfulness exercises for better sleep. Also, there are sound worlds with 3D recordings of the “most beautiful places in the world”. e.g. stream, rain, mountain stream, forests, oceans, and so on.

Unfortunately, the recordings are huge files with 45-500 minutes. So most of the time 800MB have to be downloaded first, which definitely gets in the way of relaxation.

Synctuition

Similar to Headspace, Synctuition is an app for relaxation and meditation. But here they didn’t just use dummy head recordings for the binaural sound. Music was also added and mixed into the space using spatialization tools.

So an entire sound experience was created and combined with binaural beats, which I will take a closer look at at some point. These audio experiences take 25 minutes and also a significant loading time. This could also be done better. But we are getting there.

Audible Reality

Audible Reality offers the possibility to turn spatial audio and play stereo music, for example via Spotify, in a different spatial context. The music is played in a virtual space, which is called “vibes” in the app. The whole thing is reminiscent of the YouTube hype around 8D Audio.

Similar sound colorations can be found here, such as bass-boosted music.

I think the sound personalization aspect is great, but unfortunately, the stereo suffers a lot here. Phasing artifacts can be heard. Sonarworks’ approach with Sound-ID is better thought out here.

Waves NX

Even though we’ve just ticked off the topic of head tracking, there’s a little oddball. The audio software manufacturer has its own app that can be combined with any headphones. So you can not only connect the hardware head tracker with the computer. Via Bluetooth, this is ready for use with the smartphone.

Finally, you can listen to music or your own audio in the app. Matching the Nx Virtual Mixing Room, the stereo sound in supported app now sounds as if you were sitting in Abbey Road Studio 3. However, multi-channel 5.1 surround sound has not been implemented here, as it is in the DAW plugin.

There are even dedicated headphones that have the head tracker built into the device. The Audeze Mobius 3D Headphones. So in principle, exactly what Apple did with the Airpods Max – only years later 😉

Artist Connection

Here, too, a small special role for Sony 360 Reality Audio. Again, the idea is to immerse and directly dive into the sound. More precisely into music, because here artists are also in the foreground. This is produced with Sony 360RA ‘s own tools, the Creative Suite, as it is also used on TIDAL.

There are also dedicated headphones here to further enhance the sound experience: The Sony 1000XM2, wireless headphones with noise canceling. Or the Sony WF-1000XM4 in-ears true wireless headphones.

Ammersive

With its potential to reduce stress and anxiety, improve cognitive performance, and provide a sense of relaxation and calm, an ambient immersive soundscape can be a powerful tool. Further research is being conducted as we strive to gain deeper understanding of this process in search of more holistic solutions for managing mental well-being.

Ammersive is an app that facilitates such incorporation of unique immersive audio experiences with ease. Ambient immersive soundscapes are created with spatial audio, which creates a “3D” listening experience, allowing users to feel as if they are actually in the environment being represented.

However, not all individuals may experience the same effects from soundscapes. It is important to take into account individual responses when listening and to give yourself permission to stop listening at any time if the sounds make you uncomfortable or trigger an unwanted response.

It is worth exploring both ambient sounds and immersive soundscapes as they can have therapeutic effects cited by many studies.

Music streaming services

Meanwhile, some music streaming platforms offer music in Dolby Atmos or 360 Reality Audio. Here, we would like to refer to this blog entry.

Recap and action!

As you can see, there are now really many ways to enjoy spatial audio content. Fortunately, most of the already very popular streaming services recognize the potential of immersive listening experiences. Hopefully, head tracking compatible headphones will find favor.

Because in combination with all the apps and streaming hype, this could be the biggest chance yet for 3D audio to finally find its rightful recognition in the market!

But the right technology also needs the right content. No matter whether Apple Airpods-Pro or Samsung Galaxy Buds-Pro. Up to now, existing material has often been “converted” into corresponding spatial audio formats, or upmixed.

The success of spatial audio technology depends on both hardware and content, and I hope this article highlights the need for creative content specifically designed to leverage the technology’s capabilities.

But the true potential of spatial audio lies in creating content specifically to get the best out of the technology with creativity. Spatial audio and head tracking technology have the potential to revolutionize the way users consume audio content, creating a more immersive and engaging experience.

And that’s exactly my job here at VRTonung, if you want to learn more about it or even already have ideas in mind, don’t hesitate to get in touch!