Skip to content

Keep people interested in you through synced images as you speak with a rpi + touchscreen necklace - a project for stupid hackathon 2018

Notifications You must be signed in to change notification settings

traumverloren/speech-to-image-necklace

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

34 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Speech to Image Necklace

See images that maybe (?probably not?) correlate with what you are saying as you are saying it.

demo video

This project uses a Raspberry Pi Zero W Raspberry Pi 3, usb microphone, hyperpixel4 touchscreen display, google cloud speech recognition API, & google custom search API. Written in Javascript!

Setup:

  1. first, check your arm chip: uname -m

  2. install node.js & npm:

    if it doesn't say arm6, 🎊 yay! Installing node.js & npm is gonna be a breeze! ☮️

    curl -sL https://deb.nodesource.com/setup_10.x | sudo -E bash -
    sudo apt-get install -y nodejs
    node -v
    npm -v
    

    😠 if uname -m said arm6 (cuz you are using a Pi Zero W), i'm really sorry, you have to install node the following way and the app is probably not gonna work... :

    wget https://nodejs.org/dist/v8.11.4/node-v8.11.4.tar.gz
    tar xf node-v8.11.4-linux-armv6l.tar.xz
    node-v8.11.4-linux-armv6l/bin/node -v
    cd node-v8.11.4-linux-armv6l/
    sudo cp -R * /usr/local/
    export PATH=$PATH:/usr/local/bin
    node -v
    npm -v
    
  3. git clone or copy over ssh to pi zero using scp:

    git clone https://github.com/traumverloren/speech-to-image-necklace.git

    OR

    scp -r speech-to-image-necklace pi@YOUR_PI_NAME_HERE.local:projects

  4. install npm dependencies & SoX:

    cd speech-to-image-necklace
    sudo apt-get install sox libsox-fmt-all
    npm install
    
  5. set up secret key files:

  • for use of the google speech api, you'll need to create an account and include your own keys json file and name it thijs-vision.json

  • for use of the custom search api, you'll need to set that up as well and include your API_KEY in the keys.js file.

  • move both files over from your local machine to rpi:

    scp -r keys.js pi@YOUR_PI_NAME_HERE.local:projects/speech-to-image-necklace
    scp -r thijs-vision-keys.json pi@YOUR_PI_NAME_HERE.local:projects/speech-to-image-necklace
    
  1. Install Hyperpixel4
git clone https://github.com/pimoroni/hyperpixel4
cd hyperpixel4
sudo ./install.sh
  1. Turn on USB Mic: (skip to mid-Step 4) http://wiki.sunfounder.cc/index.php?title=To_use_USB_mini_microphone_on_Raspbian

Running:

On the raspberry pi (over ssh, preferably), run in project folder:

npm start or just node app.js


Made by 🐡Stephanie🐺 for the 💩Stupid Hackathon Amsterdam🌈

About

Keep people interested in you through synced images as you speak with a rpi + touchscreen necklace - a project for stupid hackathon 2018

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages