Music Studio is an ongoing project of mine where I am exploring the future of mixed reality music making environments and tools, while learning some audio programming and DSP along the way. What does mixed reality mean for musicians? If the future of mixed reality promises a world that merges the digital with the physical, what would a holographic music studio be and how would it function?

For starters I wanted to build a self-contained miniature digital music work station that runs on the HoloLens. This is a massive task for one person of course, but part of the appeal for me is actually just to learn more about the ins-and-outs of programming for audio synthesis, processing, recording and manipulation in the context of making digital music.

Currently I have a implemented a basic audio framework library, and from that library built a polyphonic FM synthesizer (3 operators and 2 envelopes) and Piano Roll.

Interface for FM synthesizer in Unity

Interface for FM synthesizer in Unity

Snapshot of the piano roll in action

Snapshot of the piano roll in action