Week 4 2024 Spring

Homework:

• Reading:

  • Real-time Human Pose Estimation in the Browser with TensorFlow.js
  • Introducing BodyPix: Real-time Person Segmentation in the Browser with TensorFlow.js
  • On-device, Real-time Body Pose Tracking with MediaPipe BlazePose

• Video:

  • ml5.js Pose Estimation with PoseNet

• Coding:

  • Build an interactive browser experiment on Webcam Poses data
  • Publish your project on GitHub or your own blog, or record a video and put it on your blog. Add your project link below.

See demos live

• Posnet
• Posnet Multiple Noses (Detect multiple poses, draw nose on each pose)
• Posenet Nose tail Save nose previous positions
• Posenet Vis Posenet, draw different visualized lines
• PoseNet Move the Stickman
• PoseNet with KNNClassification
• PoseNet with Teachable Machine
• PoseNet Video + Music
• PoseNet Video + Music + Multiple Squares
• PoseNet in Zoom, code, demo
• BlazePose
• BodyPix
• BodyPix Parts
• BodyPix Parts Custom Color
• BodyPix Bubbles
• BodyPix Change Background
• UNET_webcam

Inspirations about Poses:

• Moving morrir
• Sidewalk Orchestra
• Making music by posing melody shapes to my webcam
• Make music with Posenet from ml4a
• PoseNet in ml5.js
• Semi-Conductor
• Body, Movement, Language: AI Sketches With Bill T. Jones
• Touch Type
• nixel-Body
• Mixing movement and machine
• DeepSquat
• Pose Animator
• Web Olympic
• AR Body Filter
• Amazing Art Installation Turns You Into A Bird | Chris Milk "The Treachery of Sanctuary"
• Puppet Parade - Interactive Kinect Puppets
• ballet rotoscope

Questions?

• p5 play sprite animation: https://molleindustria.github.io/p5.play/examples/index.html?fileName=sprite3.js
• tfjs toxicity model demo in p5js
• Magenta.js
• Teachable machine on pose: code not using ml5, only teachable machine pose library and p5js.

Add your name / link to your assignment below

• Alan Ren, 3D Body Pose mapping
• Yian Chen, Pose
• Jing Cao, finding eyes
• Vivian Xie,drawing with nose
• Nathan Duker, Random Activity
• Andrew Trousdale, pose experiment
• Ruby Zhang, Work in Progress Live Posture Recognition
• Octavio Figueroa, Work in Progress Hand drum
• Mirana Mei, Singing Rain
• Tamanna Jain, Poses Shapes
• Weber Wong, Bodypix Tint