This is the source code and sounds to the A.I. Experiment, NSynth: Sound Maker.
This experiment lets you play with new sounds created with machine learning. It's built using Nsynth, a research project that trained a neural network on over 300,000 instrument sounds.
NSynth lets you select and combine two sound sources. Use the slider to change the interpolation between the two sound sources.
To install the dependencies and build the project, in the terminal run:
npm install webpack -p
You can then run a local server to play the site.
All of the sound combinations can be found in the
sounds folder. The files are named with the two instrument sounds and an underscore in between. Inside the file you will find 35 mp3 files. The mp3s are named with their interpolation point (0-4), then an underscore, then their midi note value.
Bass_Trombone_Solo_A_bike_bell/1_68.mp3 is a combination of
bike bell. Since the file is called
1_68.mp3, that means it's the second interpolation point between trombone and bike bell (25% trombone and 75% bell) and the note value is 68 (G#5).
The samples aren't always perfectly in tune and they do sound a bit unusual – but we think that’s what makes them fun.
You can play the keyboard by touching or clicking the keys or plug in a MIDI keyboard. The center row of your computer keyboard will also trigger the keys.