Skip to content
Play games without touching keyboard
Python
Branch: master
Clone or download
Latest commit 9395097 Sep 7, 2019
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
demo first commit Sep 6, 2019
resources Add files via upload Sep 6, 2019
src Add files via upload Sep 6, 2019
LICENSE Add files via upload Sep 6, 2019
README.md update Sep 7, 2019
battle_city.py Add files via upload Sep 6, 2019
chromedriver Add files via upload Sep 6, 2019
dinosaur.py Add files via upload Sep 6, 2019
mario.py Add files via upload Sep 6, 2019

README.md

[PYTHON] AirGesture - Play games without touching keyboard

Introduction

Here is my python source code for AirGesture - Play games without touching keyboard. This project is an application of hand detection model in Tensorflow. With my code, you could play many games on PC without using any keyboard. At the moment you could play the following games

  • Super Mario Bros by running the script mario.py
  • Battle City by running the script battle_city.py
  • Dinosaur Game by running the script dinosaur.py

Please make sure that only one hand shown in front of camera. Otherwise scripts may not work as well as you expect

Super Mario Bros

The screen is splitted into 3 equal parts horizontally. Here is the mapping between your gesture and Mario's movement:

  • Open hand within the left part -> Left jump
  • Closed hand within the left part -> Left run
  • Open hand within the middle part -> Jump
  • Closed hand within the middle part -> Do nothing
  • Open hand within the right part -> Right jump
  • Closed hand within the right part -> Right run


Super Mario Bros

Battle City

The screen is splitted into 5 parts, including 4 triangles and a circle. Here is the mapping between your gesture and tank's movement:

  • Open hand -> Fire
  • Closed hand within the circle -> Do nothing
  • Closed hand within the left triangle -> Go left
  • Closed hand within the right triangle -> Go right
  • Closed hand within the up triangle -> Go up
  • Closed hand within the left triangle -> Go down


Battle City

Dinosaur Game

The screen is splitted into 2 equal parts vertically. Here is the mapping between your gesture and dinosaur's action:

  • Closed hand -> Run
  • Open hand within the upper part -> Jump
  • Open hand within the lower part -> Duck


Dinosaur

Requirements

  • python 3.x
  • cv2
  • tensorflow
  • numpy
  • gym
  • gym_super_mario_bros
  • gym_chrome_dino
  • pygame
  • opencv
You can’t perform that action at this time.