Gesture sound mapping using MobMuPlat. This is the result of a project in the course Musical Communication and Music Technology(DT2213) at KTH Royal Institute of Technology, Stockholm.
Written by Simon Johansson, Isak Nilsson and Helga Svala Sigurdardottir.
This is a two-part instrument using one or two smartphones. The sound generation and gesture mapping is written in pure data using the API of MobMuPlat. The primary melody instrument generates a synthesized string sound and is controlled by tilting the phone. Karplus-Strong string synthesis was used to generate the plucked string sound. The secondary rhytmic instrument generates a drum sound and a bass string sound when tilted. The bass sound follows the root chord note of the melody instrument if played with two phones.
The timbre of the strings can be altered from the grafical interface. This 2D grid changes the width and cutoff parameters in the Karplus-Strong algorithm.
- Download the MobMuPlat app.
- Download and open main.pd and main.mmp from your smartphone.
- Open the app, go to the network settings and set the input and output port to the same value (e.g. 54321).
- Open the main.mmp file within the app.
The pure data patch is only tested on Android and not OSX. The MobMuPlat app sometimes crashes for unknown reasons.