Hand Gesture Recognition

Hand Gesture Recognition is a project aimed at developing a system capable of accurately detecting and recognizing hand gestures in real-time. Hand gestures serve as a powerful form of non-verbal communication and can be utilized to control a wide range of applications and devices. This project leverages computer vision techniques and machine learning algorithms to analyze video input from a webcam and identify specific hand gestures.

Features

V1.3.1 (Available 2023-06-16) ✅

• Add Paper Rock Scissors game

V1.3.0 (Available 2023-06-09) ✅

• Add new Tkinter mode, key z and tkinter_mode 1
• Create a Widget to show a image

V1.2.1 (Available 2023-06-02) ✅

• Integrate the slider widget with the hand gesture recognition system

V1.2.0 (Available 2023-06-02) ✅

• Add hand gesture recognition to control the slider widget (Clamping)
• Add new mode to enable Tkinter, key t and mode 2
• Add new Tkinter mode, key c and tkinter_mode 0

1.1.0 (Available 2023-06-02) ✅

• Configure Tkinter
• Create a Widget to show a slider

1.0.1 (Available 2023-05-27) ✅

• Detect if all hands are closed to exit application

1.0.0 (Available 2023-05-27) ✅

• Real-time hand tracking.
• Detection and display of finger landmark points.
• Drawing lines representing the movement of the index finger when it is raised.
• Clearing the drawn lines when the hand is opened.
• Text messages indicating the hand state (open hand, closed hand, raised index finger).

Prerequisites

• Python 3.9.6
• OpenCV
• MediaPipe
• WebCam

Installation

Install the required libraries by executing the following command in your terminal:

pip3 install -r requirements.txt

Usage

1. Run the Python script hand_tracking.py in your development environment or execute the following command in the terminal:

python3 hand_tracking.py
python3 hand_tracking_tk.py
python3 hand_tracking_game.py

2. A window will open showing the live camera feed with the overlay of hand landmark points and lines tracking the movement of the index finger when it is raised.

3. To exit the program, close either hand.

Demonstration

https://drive.google.com/file/d/1GdiIMFSnSwg4b0-_ezIB-5S1d88U3Tza/view?usp=drive_link (simple) https://drive.google.com/file/d/1ZMPuHZ25x8bn6H5G6b4Tvw4An6gMjx8D/view?usp=drive_link (complete)

Limitations

The current implementation of the hand gesture recognition system has the following limitations:

• The Python version is limited to 3.9.6, as the MediaPipe library is not compatible with Python 3.10+.

Contributors

Natan

William

Work developed during the Digital Image Processing course at the University of Passo Fundo - 2023/1.