A simple python app to play several songs using your fingertips. Connect your finger tips to the tip of your thumb. Release to stop the song.
mediapipe==0.9.0
opencv-python==4.2.0.34
numpy==1.22.4
sounddevice==0.4.5
soundfile==0.11.0
Create a conda environment and use pip
package manager to install the required packages.
-
Activate your conda environment that is used in this project.
-
Move to the directory where
hands_mediapipe.py
is located -
Run the following command
python hands_mediapipe.py
-
Have fun with the hand detection and playing the songs by connecting and releasing tipping of your fingers and your thumb tip.
-
Press
Esc
to close the program.
You can provide any .wav
files for the song that you want to play in sound-resources
directory.
- Improve robustness of the fingertip detection
- C++ implementation for GPU utilization
- More interactive GUI and HUD display
- Noizz (a huge library of royalty free loops and samples)