XRSynth - VR and AR Synthesizer
Abbey Road Red Hackathon on 10-11 November 2018 at the Abbey Road Studios.This project was created during the
- Pedro Alvarez - Unity programming, 3D environment creation, object interaction,
- Tomasz Rudzki - Unity and C++ (JUCE) integration, C++ synth plugin code,
- Ed Storey - DSP programing, C++ synth plugin code.
The project won the Most Original Idea prize sponsored by the London Field Brewery.
XRSynth is as an engaging, hyper-realistic XR experience, an introduction to the world of generative music.
XRSynth is a project that explores a new and unorthodox way of interacting with synthesizers. By mapping the physical behaviour of one or more virtual objects to the parameters of the synthesizer, we have created an instrument that encourages a different approach to sound design. This may allow composers and artists formulate ideas based on generative inputs. It also allows for those without any knowledge of sound design to engage with experimentation in sound. There is broad scope for this project, with application in video game development, augmented or virtual reality and lends itself to interest for end users with all levels of experience.
This app was built by writing both a small virtual world in the unity engine in C# and synthesiser plugin in C++ using the JUCE framework. The plugin was integrated in the unity framework using the new JUCE Unity integration system.
What's next for XRSynth: User Interface tweaking. Implementing more advanced audio synthesis algorithms. Spatial audio implementation. Testing and optimization for the VR and AR headsets.