Week 1 2020 Fall

Homework:

• Video:
  • Intro to ml5
  • Image classifier with ml5 and MobileNet
• Coding:
  • Build on top of the image classifier example(demo) from the coding session. Publish it on your blog / GitHub. Add your homework link to the list below.
  • Or try any of the ml5js examples, make something based on any of these examples.

Help:

• ml4w-homework: How to push code to a Github Repo and host sketch on Github
• Video: How to host p5 sketch on GitHub pages

Resources:

• ml5 image classifier webcam on p5 Web Editor Full screen example, examplel with code
• All image classifier demos from week 1
  • Image classifier with webcam plain javascript (This demo works on Mobile Phone. Please use Safari browser on ios(iPhone), or Chrome browser on an android phone), code
  • Image classifier with speech output using MobileNet and p5.speech. See code Here.
  • Image classifier with translated restults and speech output using MobileNet, Google Translate API and p5.speech (To run this example, you need to replace the google API key in the sketch.js). See code here
  • Webcam Scavenger Hunt Game using MobileNet, p5.js, p5.speech. See code here.
• ml5.js examples
• tf.js examples
• Core Concept of TensorFlow.js
• Google AI experiments
• A Beginner's Guide to Machine Learning with ml5.js, introduction to tf.js 6.1 - 6.5

Inspirations about image classifier

• Emojis Scavenger Hunt
• Thing Translator
• Giorgio Cam
• Safty glasses on, shop machine running

Some ideas

You can -

• change the sketch background, show an image/gif, play a song when MobileNet recognizes a certain object.
• use p5.speech library to say the results from the mobile
• use Google Translate to translate the results to another language
• make an emoji webcam scavenger hunt game
• connect p5 sketch to an Arduino board through serial communication, when MobileNet recognizes a certain object, light up a LED.

Questions?

• add your question here

Add your name / link to your assignment below

• Your name, [Project name](Project Link), Project Description
• KJ Ha, Image Classifier with Emojis
• Yen Chen, Wear a mask, please!
• Julie Lizardo, Voice-Controlled Puzzle
• Fanyi Pan, Singer's Poem with mobileNet
• Ji Park, Animal Classifier
• Sihan Zhang, Scavanger Hunt Game
• Philip Cadoux, Spotlight Photosynthesis
• Jeeyoon Hyun, Which Kind of Jeju Bird Are You?
• Michelle Sun (Pei Yu), Smile for a Selfie / P5
• Zoe Gao (Ziyu),Find My Sunglasses