SwiftAR

P4 Elective: Mobile Programming with Swift and ARkit (+MLCore)

Demo

https://vimeo.com/280514320

Gesture Recognition

Step 1 ✅

Understand Hanley Weng's Hand Gesture Recognition and use it as Base for this Project.

Step 2 ✅

Create Models for Gestures ✊ Grab 🤚 Release 👈 Aim (Bad recognition) 👆 Shoot (Bad recognition)

Microsoft Custom Vision

Step 3

Use Gestures to control an AR-Object with the Force ✅ and shoot Laser Beams. ❌ 😅

Step 4

(Multiplayer) Shooter? / Force Game? ❌

Credits

Storm Trooper by blackcatmignon: https://sketchfab.com/models/9c80ee9978834250bd5940a3fb97e56b#

TIE Fighter by GaryPhelps: https://sketchfab.com/models/720c1e633729446b91e339eacb23de3a

This Experiment is not affiliated with, associated to, nor endorsed with Star Wars / Lucas Arts / Disney in any way. 🙈