Skip to content
Switch branches/tags

Latest commit


Git stats


Failed to load latest commit information.
Latest commit message
Commit time


A sign-language to speech application that uses the LeapMotion to track gestures and the WekiMini to map gestures to sentences.

The project was originally created in the Hack2Wear hackathon (2014), together with Ilai Giloh and Mel.

How to run it?

  1. First, you will have to install the WekiMini.

  2. In addition, I use leap_python3 as a git submodule, so make sure to pull the submodule and compile it (see instruction in the link) before running.

  3. Install the rest of the dependencies with pip install -r requirements (preferably into a virtuel env).

  4. Make sure you have a voice rss key, to convert text to speech. Get one and export it with export VOICE_RSS_KEY=<YOUR KEY>.

If you are using autoenv you can write the above line to a secrets file and it will be sourced when you change into the project directory.

  1. Start the WekiMini. In the input section choose 30 inputs and in the output section choose the type: "All dynamic time warping" with X gesture types where X is the number of expected sentences you want to work with. Hit next.

  2. Run ./ It will start to pass data from the LeapMotion to the WekiMini and get data back, convert gesture IDs to text and play the sentences.

Some WekiMini functions are still not fully automated. For example, you will have to find the sweet spot of the threshold slider manually using the WekiMini GUI.

  1. Enjoy


Sign language to speech with Leap motion (@ Hack2Wear 2014)



No releases published


No packages published