Skip to content
Play a Beat Saber clone with hand movements using Tensorflow.js & PoseNet
JavaScript HTML CSS
Branch: master
Clone or download
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
assets add hand obj Oct 22, 2019
build
dist trying again Oct 24, 2019
src test changing webpack config Oct 24, 2019
vendor
.babelrc first commit Sep 3, 2019
.gitignore
LICENSE test something Oct 24, 2019
README.md add link to blog post Oct 24, 2019
demo.gif update README Oct 23, 2019
package.json test Oct 24, 2019
webpack.config.js test Oct 24, 2019

README.md

BeatPose

Play a Beat Saber clone with hand movements using Tensorflow.js & Posenet, in the browser! 🎉

Based on the awesome work by Supermedium on the beat saver viewer.

Live demo: https://beat-pose.netlify.com/

Blog post

Demo

Play BeatSaber with hand movements

How to use

  • Visit the live demo
  • Allow access to the webcam
  • Place yourself about 1-2m away from your computer in a place that has enough light.
  • Move your hands to see if the recognition works
  • Start playing and hit beats!

Rules

None! It's not a real game, more of an experiment 🙂.

The only "restriction" is that the left hand can only destroy the red beats and the right hand, the blue beats.

Tech stack

Development

To run locally, clone this repository and run:

npm install
npm run start

Then open localhost:9999 in your browser and the default song should be Bohemian Rhapsody - Queen, but you can search for other songs in the bottom search bar.

Support

These kinds of side projects take me a lot of time so, if you like them, your support would be really appreciated if you want to/can 🙂.

ko-fi

You can’t perform that action at this time.