GesturePod (for MKR1000)
Table of Contents
GesturePod is a plug-and-play, gesture recognition device. GesturePod can be clamped onto any white-cane used by persons with Visually Impairment. Simple and natural gestures performed on the cane triggers corresponding activities on the phone. The gesture recognition system on the cane is powered by (real time and robust) Machine Learning (ML) based classifier ProtoNN. This repository contains the code for recognizing the gestures and communicating the gesture over Bluetooth Low Energy (BLE). The pertrained model can recognize 5 gestures - Double Tap, Right Twist, Left Twist, Twirl and Double Swipe with an accuracy of 99.87.
Clone the repo and navigate to this folder
git clone ... cd Applications/GesturePod/onMKR1000
Refer to this tutorial (Coming Soon ..!) to build the Hardware and setup external dependencies - Cortex M0+ Board support.
Compile, Build and Upload Select the
COMport to which MKR1000 is connected. Upload the code.
COMport and perform gestures on the cane to get the results of live predictions.
Blog post Coming soon ..!
Make your own GesturePod. Don't have time? No issues, checkout the simulation on your computer with preloaded sensor values Coming Soon ..!