-
Notifications
You must be signed in to change notification settings - Fork 0
Project Details
NeuroPixel: EMG-Controlled Accessible Gaming Console and Arcade Hub
Modern gaming systems and arcade consoles are primarily designed for users with full hand mobility and fast motor coordination, making them difficult or impossible to use for individuals with physical disabilities and neuromuscular disorders. People living with conditions such as spinal cord injuries, ALS, cerebral palsy, muscular dystrophy, stroke-related paralysis, limb loss, arm dysfunction, and lower-limb disabilities often face significant barriers when interacting with traditional keyboards, controllers, touchscreens, pedals, or arcade systems. While assistive technologies such as eye tracking and brain-computer interfaces exist, they are frequently expensive, difficult to calibrate, mentally demanding, or inaccessible for everyday gaming use.
At the same time, many individuals with severe motor limitations still retain small voluntary muscle activations in areas such as the jaw, neck, forehead, shoulders, facial muscles, or residual limbs. These muscle activations generate EMG (Electromyography) signals that can be detected and translated into digital commands. However, there are very few affordable gaming platforms that effectively utilize EMG signals to provide an enjoyable, accessible, and engaging gaming experience. As a result, many users with disabilities are excluded from recreational gaming activities that support social interaction, entertainment, reflex development, cognitive stimulation, neurological response improvement, and stress relief. There is therefore a need for an adaptive and inclusive gaming system that can convert residual muscle activity into intuitive controls while allowing users with limited mobility to independently play arcade-style games for both fun and therapeutic benefits.
NeuroPixel addresses this challenge by developing an EMG-controlled gaming console and arcade hub that enables users to play games using muscle signals instead of traditional controllers. The system uses surface EMG sensors to detect voluntary muscle movements from accessible body regions such as the jaw, neck, shoulders, forehead, or facial muscles. These signals are amplified, filtered, and processed by a microcontroller, which converts them into gameplay commands such as jumping, moving left or right, selecting options, shooting, or pausing the game.
The console features five classic arcade-style games, including Google Space Invaders, Google Chrome Dino, Flappy Bird, Pac-Man, and Snake, all adapted for EMG-based interaction. Each game is designed to improve hand-eye coordination, reflexes, concentration, and neurological response time while also providing an enjoyable gaming experience. The system includes adaptive calibration that allows each user to customize controls according to their muscle strength and movement capability, ensuring accurate and reliable interaction.
NeuroPixel also integrates accessibility features such as audio feedback, large visual indicators, customizable sensitivity settings, and optional voice-command support to create a more inclusive experience for users with arm and feet disabilities. By combining assistive technology, signal processing, and accessible arcade gaming into one affordable platform, NeuroPixel promotes independence, inclusion, rehabilitation support, and equal access to digital entertainment.
NeuroPixel is specifically designed for individuals who retain partial voluntary muscle control despite limited hand, arm, or lower-limb mobility. The system supports users with spinal cord injuries, ALS, cerebral palsy, muscular dystrophy, multiple sclerosis, stroke-related paralysis, partial locked-in syndrome, ataxia, amputations, and other neuromuscular conditions. Even users with very limited physical movement may still produce detectable EMG signals through actions such as jaw clenches, forehead contractions, shoulder shrugs, or neck movements, making the system highly adaptable to different disabilities and levels of mobility.
The project combines hardware and software technologies to create a fully interactive and accessible gaming environment. Surface EMG sensors capture electrical activity generated by muscles, while embedded software processes and classifies these signals into predefined commands. The processed commands are then mapped to gameplay mechanics across different arcade games. For example, a short muscle contraction may trigger jumping in Chrome Dino or Flappy Bird, while directional muscle activations may control movement in Pac-Man or Snake. In Space Invaders, muscle signals can control movement and shooting actions.
Beyond entertainment, NeuroPixel also focuses on improving reflexes, reaction speed, concentration, and neurological responses through interactive gameplay. Arcade-style games require repeated muscle activation and quick responses, which may help users improve coordination and maintain cognitive engagement over time. The project demonstrates how affordable EMG-based interfaces can be used not only for assistive interaction but also for rehabilitation-oriented gaming and inclusive recreation.
The system is developed using low-cost and widely available components such as MyoWare EMG sensors, Arduino or ESP32 microcontrollers, and custom game software. The modular design allows future expansion into multiplayer gaming, machine learning-based gesture recognition, wireless EMG wearables, and additional accessible games. NeuroPixel ultimately aims to bridge the gap between assistive technology, therapy, and entertainment by creating a gaming ecosystem where people with physical disabilities can play independently, confidently, and enjoyably.
NeuroPixel is an EMG-controlled accessible gaming console and arcade hub that allows people with arm and feet disabilities to play games using muscle signals instead of traditional controllers. The system detects EMG signals from areas such as the jaw, neck, shoulders, or forehead and converts them into gameplay commands. The console includes five accessible arcade games — Google Space Invaders, Google Chrome Dino, Flappy Bird, Pac-Man, and Snake — designed to provide fun while also improving reflexes, concentration, and neurological responses. By combining assistive technology, accessible game design, and EMG signal processing, NeuroPixel creates an affordable, inclusive, and rehabilitation-friendly gaming experience for users with limited mobility.