Do tip of tongue tracking with Kinect v2.
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Type Name Latest commit message Commit time
Failed to load latest commit information.

Youtube Video

Blog Post

Steps to track tip of tongue:

Get the mouth area in the depth image by using face tracking.

Get the smallest depth(then it is closest to the Kinect sensor) inside the mouth area. That's the depth part of the tongue's tip!

Get the relative position according to the mouth area to know the tongue's direction.

Show the tracking results when the mouth is open.

Public Variables:

float TongueX; tip of tongue's X-axis. Value 0 to 1 represents mouth's left side to right side.

float TongueY; tip of tongue's Y-axis. Value 0 to 1 represents mouth's top to bottom.