Home

Overview

This is an Unreal Engine Editor Plugin that provides Multi-Modal Interaction for Developers. With the plugin providing users interaction on common unreal aspects through:

• Voice Commands (Push-To-Talk)
• Eye Tracking

Example

With an Open Blueprint Editor, and using the Push-To-Talk Function. Command: "NODE 4 MOVE LEFT 200"

Before:

After:

Plugin Runtime

The Plugin has Two Separate Runtime Components:

• C++ (UI and Audio Gathering)
• Python (Transcription Generation)

Next Steps

First, read the Installation Page for plugin installation. Then, follow the instructions provided in the Getting Started Page.