An Augmented Reality Android app that detects and tracks the user's hand and renders a colored cube on it.
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
app
gradle/wrapper
.gitignore initial commit Sep 22, 2016
README.md
ar_final.JPG
ar_stage.JPG
build.gradle
gradlew
gradlew.bat
import-summary.txt
settings.gradle initial commit Sep 22, 2016

README.md

Hand-Detection-AR

This is an Augmented Reality Android app. It detects and tracks the user's hand in real time and augments a rotating cube on top of it. The rotation speed can be set by the user by holding up the corresponding number of fingers.

Watch video here.

The methodology, as illustrated above, is:

  • Take user input and detect hand color in HSV
  • Segment hand and compute convex hull
  • Use convex hull to detect fingertips
  • Use distance transform to estimate palm center
  • Render cube at palm center
  • Set cube rotation speed with finger recognition
  • Estimate depth with contour size and set cube scale

Screenshot of final app in action: