Week 1 2019 Fall

Homework:

• Reading: Is this AI? We drew you a flowchart to work it out
• Video:
  • Intro to ml5
  • Image classifier with ml5 and MobileNet
• Coding:
  • Build on top of the image classifier example(demo) from the coding session. Publish it on your blog / GitHub. Add your homework link to the list below.
  • Or try any of the ml5js examples or tfjs examples, make something based on any of these examples.

Help:

• ml4w-homework: How to push code to a Github Repo and host sketch on Github
• Video: How to host p5 sketch on GitHub pages

Resources:

• ml5 image classifier webcam on p5 Web Editor Full screen example, examplel with code
• All image classifier demos from week 1
  • Image classifier with webcam plain javascript (This demo works on Mobile Phone. Please use Safari browser on ios(iPhone), or Chrome browser on an android phone), code
  • Image classifier with speech output using MobileNet and p5.speech. See code Here.
  • Image classifier with translated restults and speech output using MobileNet, Google Translate API and p5.speech (To run this example, you need to replace the google API key in the sketch.js). See code here
  • Webcam Scavenger Hunt Game using MobileNet, p5.js, p5.speech. See code here.
• ml5.js examples
• tf.js examples
• Core Concept of TensorFlow.js
• Google AI experiments
• A Beginner's Guide to Machine Learning with ml5.js, introduction to tf.js 6.1 - 6.5

Inspirations about image classifier

• Emojis Scavenger Hunt
• Thing Translator
• Giorgio Cam
• Safty glasses on, shop machine running

Some ideas

You can -

• change the sketch background, show an image/gif, play a song when MobileNet recognizes a certain object.
• use p5.speech library to say the results from the mobile
• use Google Translate to translate the results to another language
• make an emoji webcam scavenger hunt game
• connect p5 sketch to an Arduino board through serial communication, when MobileNet recognizes a certain object, light up a LED.

Questions?

• add your question here

Add your name / link to your assignment below

• Your name, [Project name](Project Link), Project Description
• Vibert Thio, Trap Boy Generator, become a trap boy in 3 seconds.
• Andrew Lee, MobileNet Demo, basic visualization of probabilities with vega-lite
• Chenyu Sun, Ghost Hunter, Tried a little bit of image classifier
• Hayk Mikayelyan, Chuck Noris running MobileNet, Random quotes from Chuck Norris using the words classified by MobileNet model
• Matt Ross. 3D Face Bagels, Posenet -> TouchDesigner, Mapping Faces, Recording Audio, and mapping them into a 3D Space with Audio Reactions
• Cara Neel, Glasses Taunter, Image classifier that will make fun of you when you show it your glasses.
• Atharva Patil, Packing Assistant, Image classifier - MobileNet to help people pack and not forget important things while travelling.
• Alvaro Lacouture MobileNet to Text, Image classifier, it displays the text of objects detected with the size according to the confidence measurement.
• Ashley Jane Lewis Coffee Alert, makes different sounds based on different beverages
• Shiyu [Image Recognition] (https://lenordchen.github.io/ML/ML/), Drag a picture to it..
• Ge Chang[Image Recognition]https://frosty-austin-10e56d.netlify.com Set up fireworks