MagicFight!

MagicFight! A tiny-ML game project based on Arduino Nano 33 BLE Sense, Tensorflow Lite and Unity.

Introduction

MagicFight! is a game project in which player can speak spells to fight others, like a wizard in Harry Potter. In this project, we use Arduino Nano 33 BLE Sense as the ‘magic wand’ to receive and recongize sound signals and geature signals, using its microphone, acceleration sensor and gyroscope.
A presentation video has been upload to YouTube.

Document and Report

Project Report

Requirement

• A Mac computer that can run Unity.
• Two Arduino Nano 33 BLE Sense boards.

Installation

Game Deployment

The exe executable file of the Unity game is still on development. However, if you want to try the game, you can import the scene from unity folder and play the game in debug mode. You should also import these five packages to make it run:

• Health System by Code Monkey
• Flat Platformer Template
• Cute 2D Girl - Wizard
• Arduino Bluetooth Plugin
• Animated Fireballs

Board Scripts Upload

1. To upload scripts to your boards, you should first install Arduino IDE and install necessary libraries. You can follow the installation guidelines on the official website.
2. Install EloquentML library, LSM9DS1 library, ArduinoBLE library and Arduino_CMSIS-DSP library in Arduino IDE’s library manager.
3. Open board1.ino and board2.ino files (in /Board/board1 and /Board/board2 folder) in Arduino IDE.
4. Compile and upload to your boards.

For now, the model is only trained by two person, so it may not work properly with your voice. We are currently gathering more voice data so please wait for update!