Skip to content


Subversion checkout URL

You can clone with HTTPS or Subversion.

Download ZIP
100644 40 lines (30 sloc) 1.69 kb
c121c60 @joaquimrocha Initial commit
1 ==========================
2 Skeltrack Desktop Control
3 ==========================
5 This demo is an example of what can be done with Skeltrack.
7 It needs a Kinect device, to which it connects using GFreenect, and retrieves
8 the head and hands' positions from Skeltrack. Then, the positions are
9 interpreted as gestures which are mapped to events in the desktop using Xlib.
11 This demo is not supposed to be a full-blown gesture interpretation system,
12 so, the code is tailored to use cases in the GNOME 3 desktop.
14 A video showing this demo in use can be watched at:
18 Gestures
19 ========
21 The gestures are activated when the hands are at a certain distance in front
22 of the head (around 30 cm); this is called the "action area".
24 The following list shows what gestures are interpreted as commands:
25 1) One hand moving: Move mouse pointer;
26 2) While one hand is in the action area another one hand enters
27 it and quickly leaves: Perform a click;
28 3) While one hand is in the action area another one hand enters and stays
29 there: Perform a mouse press (allowing the user to move things around
30 using the other hand);
32 Apart from the list above, there are two modes when both hands enter the
33 action area at about the same time. Those are:
34 1) Steering Wheel Mode: Both hands are interpreted as if holding a steering
35 wheel. By default the up arrow key is pressed and the left or right arrow
36 keys are pressed according to the orientation of the hands.
37 2) Pinch Mode: Both hands are interpreted as if performing a pinch gesture,
38 which results in a control + mouse wheel up/down event (because
39 this is usually interpreted as zoom in/out).
Something went wrong with that request. Please try again.