Week 3 2021 Fall

Homework:

• Reading:

  • Real-time Human Pose Estimation in the Browser with TensorFlow.js
  • Introducing BodyPix: Real-time Person Segmentation in the Browser with TensorFlow.js
  • On-device, Real-time Body Pose Tracking with MediaPipe BlazePose

• Video:

  • ml5.js Pose Estimation with PoseNet

• Coding:

  • Build an interactive browser experiment on Webcam Poses data
  • Publish your project on GitHub or your own blog, or record a video and put it on your blog. Add your project link below.

See demos live

• Posnet
• Posnet Multiple Noses (Detect multiple poses, draw nose on each pose)
• Posenet Nose tail Save nose previous positions
• Posenet Vis Posenet, draw different visualized lines
• PoseNet Move the Stickman
• PoseNet with KNNClassification
• PoseNet with Teachable Machine
• PoseNet Video + Music
• PoseNet Video + Music + Multiple Squares
• PoseNet in Zoom, code, demo
• BlazePose
• BodyPix
• BodyPix Parts
• BodyPix Parts Custom Color
• BodyPix Bubbles
• BodyPix Change Background
• UNET_webcam

Inspirations about Poses:

• Moving morrir
• Sidewalk Orchestra
• Making music by posing melody shapes to my webcam
• Make music with Posenet from ml4a
• PoseNet in ml5.js
• Semi-Conductor
• Body, Movement, Language: AI Sketches With Bill T. Jones
• Touch Type
• nixel-Body
• Mixing movement and machine
• DeepSquat
• Pose Animator
• Web Olympic
• AR Body Filter
• Amazing Art Installation Turns You Into A Bird | Chris Milk "The Treachery of Sanctuary"
• Puppet Parade - Interactive Kinect Puppets
• ballet rotoscope

Questions?

• p5 play sprite animation: https://molleindustria.github.io/p5.play/examples/index.html?fileName=sprite3.js
• tfjs toxicity model demo in p5js
• Magenta.js
• Teachable machine on pose: code not using ml5, only teachable machine pose library and p5js.

Add your name / link to your assignment below

• Yilin Zou https://preview.p5js.org/yilinzou/present/js3JJ2s8L (The monster will change when you hold both of your arms up, be careful on the volume!)
• Marcel https://editor.p5js.org/MarcelWang/full/YtEhlQUyu (wave your hands)
• Zixun Meng 1. https://editor.p5js.org/zm1029/sketches/RVeTmkMBN (say 戴墨镜🕶️ to wear yourself a pair of sunglass🐸） 2. https://editor.p5js.org/zm1029/sketches/ELw8bsolt （Create a universe by your hands)
• Michael, Dance move viz
• Mingxi,Human-MIDI, Video_1, Video_2
• Sara, body as beat player
• Nart, Using BlazePose to move a 3d Model
• Youming, Stick man pose, code
• Jenny, human alphabet log in password https://jennywangyw.wixsite.com/nyuitp/post/human-alphabet-log-in-password
• Zairan, https://editor.p5js.org/Zairan/sketches/7bPCNPTmr (angel shoots at devils)
• Lenin, Pearl game