Stems are audio files that break down a track into mixes. Obtaining them provides a myriad of use cases, such as learning music production, dubbing, and adjusting relative instrument volumes. While we could hard-code which stems are playing at a particular time, an interactive stem splitter tool provides a more ‘playful’ way of manipulating audio (and visual) output.
Setup:
- Add .mov file to video-inputs folder
- Run scripts/run_pipeline.sh to automatically create stems (this will take some time)
- Open Wekinator project, wek/WekinatorProject/WekinatorProject.wekproj and run the model
- Open stem-splitter-video/stem_splitter_video.pde
- Run chuck stem-synth-mult.ck
Further details provided here: https://medium.com/@shreyadsouza/interactive-stem-player-9dde80fe16c3