Skip to content

Custom Hand Gesture Recognition App to control Desktop applications using Google mediapipe.

Notifications You must be signed in to change notification settings

atharvakale31/Custom_Hand_Gesture_Recognition_and_Control

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

13 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Custom Gesture Control Application Guide

➢ This application performs actions ,on desktop/laptop, choosen by user.

➢ Actions are infact key presses which are triggered programatically when a
   certain gesture is detected.

➢ User has to select a static/dynamic hand gesture and associate a key press with it.

➢ Follow the steps given to get started.

Getting Started

Application GUI

Working Example:

  • Here, 1 (index finger open) is assigned to up arrow key.
  • 2 (thumb and index finger open) is assigned to down arrow key.

setting

  • We control PowerPoint Slides using above Gestures.

power_point

Tools and Frameworks used:

  • Google MediaPipe Hands
  • Python, OpenCV
  • pyQt5 designer
  • pyinstaller

Files description:

  • main.py : whole application code (including GUI)
  • gui.py : Independent GUI code. (.ui --> .py)
  • pyQt5_designer.ui : UI file generated by pyQt5 designer.
  • CGC_Guide : Application Guide.

Contributing

Pull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.

Action Items

  • Improve Code Readability.
  • Add support for mouse pointer control.
  • Dynamic UI to accommodate more Gesture-Key pairs.
  • Improve and implement Slide dynamic gesture.
  • Support for multiple Static gestures to be associated with single Dynamic movement.

About

Custom Hand Gesture Recognition App to control Desktop applications using Google mediapipe.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages