Project developed for the course "Creative Programming and Computing", held in the Master degree of Music and Acoustic Engineering, based in Politecnico di Milano. The project aims at providing to the user a different way to explore a city map, using visual and sound feedbacks to guide it towards interesting points of the city
The Soli Vagant artistic installation aims to create an interactive experience based on features retrieved from real city data. These features combined with an user's input (where they want to go) create a multimodal artistic representation of the city. The project is divided in two main parts: the visual feedback which is a particle system where all the particles move as independent agents following the paths imposed by the city's streets and the path followed by the user. On regards the installation's sound design, the data sonification pursues to associate a chord progression to the user's path choices through an L-System. The soundscape gives to the user hints on how close it is to an interest point of the city, the closer it get, the clearer the soundscape becomes.
In order to start the experience:
- Download the git repository
- Open the file named with sounscape.scd in SuperCollider.
- Run the python server running the command python mdp.py
- Run the supercolider client code pressing Ctrl + Enter.
- Run the processing code loading mdp.pde and run the visual system.
- Explore the city
The map evolves and reveals as the user explores the city. To this end, there are multiple layers of visualization
- Chaotic particles: Based on a Perlin noise, used to represent the absence of knowledge about a new place.
- Path particles: Retrieving from a geoJSON file, the particles are constraint to follow the paths near the user's location
- Wandering particles:
As the user explores, new/interest places are suggested for him to go. This interest points allow the user to develop a large-scale knowledge of the city.
The interest points suggestion is based on a Markov Decision Process framework, which aims to maximize a reward to the end of path finding optimization. Basically, the MDP framework solves the equations and then gives every possible path to a certain point in the map.
Audio generation is implemented in supercollider. It is composed of two main layers of sound design. The first one is a composition of different soundscapes recorded around different zones of the city and played through a granular synthesizer which allows to control the ratio between distorted granular sound original environment sound. The second layer is a music syntesizer which generates arpeggios based on chords sent by the python backend Python server. The chords are generated by a lindenmayer system which associates the direction (NN NW WW SW SS SE EE NE) to which the user points to a vocabulary which allows to compute grades and timing of the chords then fed to supercollider. The chords are then translated in midi notes scheduled by python and then sent to SuperCollider.
More information about the implementation of the project are available on the slides uploaded and used as aid during the final presentation of the project Creative Programming and Technology.
- Manuel Alejandro Jaramillo (ManuelAlejandro.Jaramillo@mail.polimi.it)
- Juan Camilo Albarracin Sanchez (JuanCamilo.Albarracin@mail.polimi.it)
- Marco Bernasconi (Marco7.Bernasconi@mail.polimi.it)
- Paolo Ostan (paolo.ostan@mail.polimi.it)
[1] GAYE, Lalya; MAZÉ, Ramia; HOLMQUIST, Lars Erik. Sonic City: the urban environment as a musical interface. In: NIME. 2003. p. 109-115.
[2] MASON, Stephanie; SAFFLE, Michael. L-Systems, melodies and musical structure. Leonardo Music Journal, 1994, 31-38.