4 min read

some Spatial Audio resources

Mastering spatial sound has grown increasingly essential to me lately. Here is a list of resources that I use when discussing the topic.
Image from Apple’s Working With Audio article. Shows a speaker with sound waves on top of the package shape illustrations, wh

Mastering spatial sound has grown increasingly essential to me lately. Here is a list of resources that I use when discussing the topic.


OSS

GitHub - microsoft/soundscape: An iOS application/service that aids navigation through spatialized…
An iOS application/service that aids navigation through spatialized audio - microsoft/soundscape
GitHub - emurray2/SpatialAudio: Spatial Audio learning examples
Spatial Audio learning examples. Contribute to emurray2/SpatialAudio development by creating an account on GitHub.
GitHub - cenatus/situationists-walkman
Contribute to cenatus/situationists-walkman development by creating an account on GitHub.
GitHub - cenatus/audio-ar-playground
Contribute to cenatus/audio-ar-playground development by creating an account on GitHub.
GitHub - MAJKFL/Spatialize-SSC24
Contribute to MAJKFL/Spatialize-SSC24 development by creating an account on GitHub.
GitHub - AudioKit/Cookbook: Canonical Examples for Using the AudioKit Framework
Canonical Examples for Using the AudioKit Framework - AudioKit/Cookbook

Frameworks

PHASE | Apple Developer Documentation
Create dynamic audio experiences in your game or app that react to events and cues in the environment.
Audio Engine | Apple Developer Documentation
Perform advanced real-time and offline audio processing, implement 3D spatialization, and work with MIDI and samplers.
AVAudioEnvironmentNode | Apple Developer Documentation
An object that simulates a 3D audio environment.

WWDC

Discover geometry-aware audio with the Physical Audio Spatialization Engine (PHASE) - WWDC21 …
Explore how geometry-aware audio can help you build complex, interactive, and immersive audio scenes for your apps and…
Explore immersive sound design - WWDC23 - Videos - Apple Developer
Discover how you can use sound to enhance the experience of your visionOS apps and games. Learn how Apple designers…
Immerse your app in Spatial Audio - WWDC21 - Videos - Apple Developer
Discover how spatial audio can help you provide a theater-like experience for media in your apps and on the web. We'll…
Bring accessibility to charts in your app - WWDC21 - Videos - Apple Developer
Charts are an essential tool for understanding data, and critical to understanding ourselves, our health, our finances…
Record stereo audio with AVAudioSession - WWDC20 - Videos - Apple Developer
Stereo recording is a powerful way to deliver immersive sound to listeners, fans, and family - and your app can use the…

YouTubers

Geert Bevin
Musical explorations into new expressive instruments, my actual music and other super geeky stuff.
Aura Audio
Welcome to the world of a college student who is passionate about music, science and technology. My goal is to share…

Articles

Documentation

Audio - Apple Developer
Find presentations, documentation, and development resources for working with audio on Apple Platforms.
Audio | Apple Developer Documentation
Add immersive spatial audio to your RealityKit content.
The Sound of Software | !Boring Software
How to design sound that elevates software and won't drive you crazy

Tutorials

Playing sound from a location in a 3D scene | Apple Developer Documentation
Position sound from a specific direction and automatically raise or lower volume based on the environment.
Capturing stereo audio from built-in microphones | Apple Developer Documentation
Configure an iOS device's built-in microphones to add stereo-recording capabilities to your app.

Research

Spatial Audio
The New York Times R&D website.
Enable Blind Users' Experience in 3D Virtual Environments: The Scene Weaver Prototype | Extended…
Enable Blind Users' Experience in 3D Virtual Environments: The Scene Weaver Prototype Recommendations Toward accessible…

https://www.microsoft.com/en-us/research/publication/a-taxonomy-of-sounds-in-virtual-reality/

Other

Immersive spatial audio soundscapes with the BBC Sound Effects archive
Creating an app to make, hear and personalise immersive soundscapes, plus findings from a study on AR, binaural, and…
Binaural Experiences
Binaural audio allows you to experience audio through your headphones - but hear it like it's surrounding you.

https://dcmp.org/learn/602-captioning-key—sound-effects-and-music