Designing spatial audio today involves a strange contradiction: You’re working in 3D—but using a 2D screen.

A research system called AudioMiXR proposes a different approach. Put on an augmented reality headset, and your sounds become physical objects in the room around you. A bird call floats above you as a visible sphere. A river sound sits near the floor. A fire crackles in front of you. You reach out, grab a sound, and move it. You walk around it. You adjust its position by physically placing it where you want it to be.

Stop thinking about spatial relationships and start feeling them

When users interact with AudioMiXR, something interesting happens: when you physically move a sound object and walk around it, your brain builds a physical understanding of where it is.

Compared to traditional 2D tools, AudioMiXR users showed lower cognitive effort, higher usability scores, and — crucially — greater creative experimentation. The researchers also tried more varied arrangements. They placed sounds in more unexpected positions. They did things that are simply impossible with conventional tools: walking around a sound source to hear it from different angles or placing their head inside a sound to isolate it.

Using augmented reality, it allows creators to:

See sounds as objects in space

Grab and move them

Walk around and experience them

This introduces 6 degrees of freedom (6DoF)—full physical interaction with sound.

The system, however, has limitations. Depth control — moving sounds forward and backward — is less intuitive than lateral placement. The visual-audio mapping does not always match user expectations. Physical constraints of current headset hardware make some positions difficult to reach. AudioMiXR is not yet a replacement for professional production tools.

But it demonstrates something important: the interface through which we interact with spatial audio is not a neutral container. Change the interaction model, and you change the creative output.

Step Inside the Mix: Designing Sound in AR

{{ pageEducationalSlot.headingContent[index] }}