An interactive sound experience that generates sound on the basis of the user's position in space and the movements and angles of their arms and legs. Developed using Pure Data and MediaPipe in Python.
- Make sure you have enough space to move around, such that your webcam is able to record your full body, and there should be no one else in the frame.
- Make sure you have Python and Pure Data installed.
- Install the following libraries/externals:
- Python pip libraries:
- mediapipe (NOTE: this library might not work on Mac M1 chips, the workaround from the top comment in this post might help out).
- opencv-python
- python-osc
- PureData externals:
- Python pip libraries:
- Open
main.pd
and press the start toggle in the upper left corner to turn on the sound. - Run PoseNet by running
python code/python_posenet/send_poses.py
from the terminal. - You should see something like this: