A project to make Amazon Echo respond to sign language using your webcam
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Failed to load latest commit information.
dist added launcher modal window Jul 31, 2018
.gitignore added gitignore Jul 28, 2018
README.md edits Jul 31, 2018
index.html wording Jul 31, 2018
main.js added launcher modal window Jul 31, 2018
package.json all code Jul 28, 2018
style.css added launcher modal window Jul 31, 2018


Making Alexa respond to Sign Language using Tensorflow.js

Alt Text

Try the live demo

Read the Blog Post on Tensorflow's Blog Coming Soon

Watch the video

This project has been shared extensively across social media, and covered in the press: BBC, Verge, Mashable, Fast Co, Kottke, VentureBeat, NowThis and others

Run the demo in latest Chrome/Firefox to train the model using your own words and corresponding signs/gestures. If you have an Echo plugged in closeby, it should respond, otherwise simply play around and have fun. You will need to give permission to access your webcam and microphone.

Running the code

To use the code, first install the JavaScript dependencies by running

npm install

Then start the local budo web server by running

npm start

This will start a web server on localhost:9966.

  1. Allow permission to your webcam and microphone.

  2. Add some words you want to train on.

Alt Text


To learn more about the classifier used in this repo go to KNN Image Classifier

There is a newer version of this classifier released in the new tensorflow.js which can be found here