Skip to content

ryulurala/arvis

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Arvis

This is a project to control 3D objects by hand in augmented reality.

Journal

Link(here)

Generate virtual hand

가상손-min

Computer vision technology recognizes human hands and creates virtual hands within Unity.

Extract coordinates of hands

To make the virtual hand as above, we need to extract the coordinates of the hand. So we need to extract the hand coordinates. And To extract it, the following process is required.

1. Convert to HSV image
2. Binarize the HSV image for detecting skin
3. Remove face
4. Detect contours and defects
5. Reduce the number of defects
6. Detect the center of hand
7. Find the defects of fingertips

이미지

Control AR object

농구공-min

After the above process, you can touch the AR object with your hands.

골인-min 뽑기

This may suggest a new game paradigm.

About

Control AR world by hand

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • C# 73.6%
  • C 22.7%
  • Cuda 1.4%
  • C++ 1.3%
  • Makefile 0.5%
  • CMake 0.3%
  • Other 0.2%