gesture-video-controller

🖥️ Preview

🛞 Dependencies

• Node.js v19.6.1;
• It's recommended to use Unix environments (Linux). If you are using Windows, it's recommended to use Windows Subsystem Linux;
• It's recommended to use Google Chrome Browser;

🚀 Running

Install Node.js 19.6.1 and restore the dependencies:

npm ci

Start the project:

npm start

Open your browser at http://localhost:3000.

✅ Features Checklist

• Titles List
  • Should not crash the search field when typing a search term;
  • Should draw hands on screen and make background elements still clickable 🙌;
  • Should trigger scroll up when using open palm 🖐;
  • Should trigger scroll down when using closed palm ✊;
  • Should trigger click on nearest element when using pinch gesture 🤏🏻;
  • Should trigger :hover event on elements in context, when moving elements on screen;
• Video Player
  • Should be possible to play or pause videos with the blink of an eye 😉;
  • All machine learning processing must be done through a web worker;

🌟 Credits

• This project was created in "Semana JS Expert 7.0" (JS Expert Week 7.0). Event developed by Erick Wendel.
• Classes project: https://github.com/ErickWendel/semana-javascript-expert07
• The interface was based on project Streaming Service by gunnarhawk

📚 References

• Google Machine Learning for Web Developers
• Training Machine Learning at Google
• TensorFlow Projects
• Database Used
• Convert Video to Canvas
• Tensorflow Blog
• Tensorflow Lib: face-landmarks-detection
• Workers Api
• Blink Detection Example
• Morse Code With Eye Detection
• Why webgl, cpu, webassembly