AI Virtual Keyboard:

This is a simple virtual keyboard that works with gestures using OpenCV. We will use our hand in the air to click on the keyboard.

Outcome:

Watch the Outcome.

What Have I Done:

Firstly, I've created a Hand Tracking Module using openCV, MediaPipe and Math. Then, I've created my AI Virtual Keyboard using OpenCV, Pynput, Time and Hand Tracking Module.

OpenCV is a library used for computer vision applications. With help of OpenCV, we can build an enormous number of applications that work better in real-time. Mainly it's used for image and video processing.

MediaPipe is a framework mainly used for building audio, video, or any time series data. With the help of the MediaPipe framework, we can build very impressive pipelines for different media processing functions.

Math is a built-in module that we can use for mathematical tasks.

Pynput is a library that allows us to control and monitor input devices. It contains subpackages for each type of input device supported.

Time is a built-in module that we can use for handle time-related tasks.

Required Packages:

• opencv-python
• mediapipe
• pynput
• math
• time

Usage:

• First of all you need to install all required packages.
• Then run the VirtualKeyboard.py file.
• Now rise your hand in-front of your camera.
• Use one finger to hover on the keyboard.
• Join your index and middle finger to click on your expected key.
• If you want you can open Notepad or TextEdit for getting input in there.

Tutorial:

Watch the step by step Tutorial.

Got a Question?

What to know more about my working process? Have an exciting project that could use my help? Drop me a line and I’ll try my best to get back to you!

If you have any questions that are bothering you please contact with me. If you think any line is redundant or can be removed to make the program better then you can obviously ask me or make a pull request. All of my contact links are given in my GitHub Profile.