SnapBack the smart hat!
People with short memory retention problems (for example Alzheimer's disease) sometimes cannot recall certain happy moments. Snapback is an IoT project built in 24 hours at the Xilinx Technology Showcase & Hackathon 2017 that constantly analyzes the wearer's surrounding environment and automatically snaps 15 seconds of happy moments when it detects smiling faces. The wearer can later access those videos and their happy moments will never fade!
We won 2nd place “Runner Up” prize at Xilinx Hackathon 2017!
Nhan Tran, Huan Wang, Tyler Quast, William Brickner
- Xilinx PYNQ Z1 board
- Python 3
- OpenCV 3.0
- A good looking cap (We used Nhan's Noogler intern propeller hat for this prototype)
Building and Running
- Set up PYNQ-Z1
- Instal necessary libraries in requirements.txt If you don't have pip3 installed, run this command:
sudo apt-get install python3-pip ffmpeg x264 libx264-dev
pip3 install -r requirements.txt
How it works
Webcam-equipped cap that captures happy moments by recognizing smiling faces (utilizing OpenCV Haar Cascades) and using that recognition to trigger the capture of a short video clip, which is then wirelessly uploaded to the cloud for later viewing.
Our hardware has been designed to be portable to accomodate for the active lifestyle of our memory makers. To make this possible we made some hardware modifications to accomadate for a chordless device.
For power on the go, a power block was repurposed to connect the board to a 9V power source. In this case the power source is three 9V batteries connected in parralel with electrical tape.
The peripherals that were used were from left to right: Arduino Shield - For powering the periferals USB Webcam - For capturing memories USB Wifi - A Wifi Adapter for uploading memories to the cloud. USB Splitter - A Device for allowing multiple inputs into the board.
The ardunio shield was modified to provide power to the peripherals by soldering the usb splitter power wire to the 5V pin on the board.
This protective case hold the components together in a compact and discrete manner while you walk around with the snapback.
Everything is in the case! Completely cordless! You can walk around and snapback will capture your happy moments!
Website Server Set up
- Install all the dependencies (see requirements.txt)
pip install dropbox pip install flask
- cd into the Webserver folder
export the path for flask export FLASK_APP=main.py
Run the SnapBack vision program: