In light of the coronavirus crisis, touchless interaction has become the focus of many designers and developers who create kiosks and screen-based exhibits for public spaces. Using the Leap Motion Controller and V4 SDK, our Integrated Touchless System allows users to interact with our tables and exhibits with no physical touch. This system tracks the visitor’s hand and watches for specific gestures, such as opening and closing, that give complete control over the mouse. The Integrated Touchless System is a mouse emulation system with multiple methods for onboarding and real-time feedback.
Alongside this system are three additional applications: a dynamic cursor overlay, a secondary instructional screen, and an LED system add-on. Download the latest release here. These applications are meant to provide both feedback and onboarding information to the visitor through color changes, gesture icons, and interaction information when hovering over buttons or drag areas. This repository also includes a Unity asset package that allows users to integrate support for the system into their own applications and a demo application for reference. The core system is built in .Net Framework 4.6.1 and the peripheral applications are built in the Unity Game Engine.
Important Notes:
- The Leap Motion V4 Orion SDK must be installed with a leap motion device connected for this application to function.
- This repository is meant to be built and run using the Touchless Add-on with a Leap Motion device and an Ideum Touchless Pedestal.
- The keyboard shortcut Ctrl+Alt+I will toggle mouse emulation on/off when the service is running.
Preview Video:
For full user documentation, look here: [