gesturez

Windows webcam gesture control. Tested on Windows 10 22H2.

============================

Use your webcam to:

• Adjust volume
• Adjust brightness
• Switch apps using alt+tab

Setup:

Make sure python is installed and you have downloaded the source code.

After installing python, use pip to install the dependencies. The dependencies are:

• opencv-python
• mediapipe
• pyautogui

Open cmd and navigate to the src direcory. Run main.py within the cmd to execute the program.

To close the camera window, open main.py and comment out lines 101 and 102 before executing.

If the brightness gesture crashes the program or doesn't work, chances are the brightness of your monitor can't be controlled from within Windows settings. To prevent crashing, modify the contents of the brightness functions such that the function content is only the keyword pass. The brightness functions are located in actions.py

Gestures:

Hold your hand approximately 30cm from the camera for best results.

1) Adjusting volume (thumb and index finger):

Hold close for decreasing, hold far apart for increasing. Fingers must be relatively horizontal.

2) Adjusting brightness (thumb and middle finger):

Hold close for decreasing, hold far apart for increasing. Fingers must be relatively horizontal.

3) Application switch / alt+tsb (index, middle and ring fingers):

Show the fingers to the camera and remove them from frame shortly afterwards.

============================

TODO

• More functionality
• More robust gesture detection model
• Improved performance
• Less janky volume controls
• Fix lag when calling brightness adjust (if possible)