Demo application for the MusicBricks project, combining Ircam's RIoT sensor with MTG's Freesound API.
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
osc
static
templates
.gitignore
README.md
app.py
requirements.txt

README.md

Hands-free Sound Machine

Description

Hands-Free Sound Machine is a voice and gesture controlled drum machine built using HTML5, WebAudio API, WebSpeech API and the Freesound API. The drum machine can be controlled using your voice, telling it to start, stop, set the tempo and search sounds for each pad. Sounds are retrieved from Freesound. IRCAM’s riot sensor is used to activate and deactivate steps from the sequencer and to set the tempo. Hands-Free Sound Machine has been developed at the Music Technology Group, Universitat Pompeu Fabra, by Jordi Janer and Frederic Font.

It has been developed as a prototype for the MusicBricks H2020 - ICT Innovation Action European project (Grant nr. 644871).

Video demo

https://www.youtube.com/watch?v=MOTwiOaCY3o

Installation instructions

Web app

  1. Download code, open terminal and cd into folder
  2. Install python requirements (pip install -r requirements.txt, vortualenv recommended)
  3. Get a Freesound API api key and paste it into line 214, static/js/all.js.
  4. Run web werver with 'python app.py'
  5. Open browser and point at localhost:5000
  6. Enjoy!

If no messages are being received from the RiOT sensor, make sure ports and IP addresses are configured correctly in app.py.

The speech control only works with Chrome.

Relevant links:

Relevant links: