Web accessibility for low-bandwidth inputs
Note: We have published a proof-of-concept website at https://brainsatplay.com/accessify (index.html in this repo) that ginteractively demonstrates the value proposition of this library. Check it out!
Implement a fully on-browser web navigation system for low-bandwidth inputs (e.g. BCIs).
- Enable virtual mouse interaction with CSS elements
- Control mouse via WebGazer.js
- Make buttons available for labeling and direct selection
- Flash buttons for SSVEP / P300 selection
- Accessify Chrome Extension
- Muse 2: P300 likely
- OpenBCI Daisy-Cyton: Previous literature says yes to both
- FreeEEG32
- Neurosity Crown
- Use
ssvep-stimuli
- Validate detection on a Chromebook
-
/src
: Source code/libraries
: Libraries to be published separately/core
: Core internal functions/ui
: Standard Web Component library/core
: Keyboard and Mouse components/mouse
: Internal mouse components/keyboard
: Internal keyboard components
-
/docs
: Documentation and demo site
Customizable keyboard with SSVEP / P300 controls
Virtual mouse
- p300: Basic P300 Detection
- potentials.p300(): Basic P300 Detection
- ssvep: Basic SSVEP Detection
- hightime.fbcca(): Filter Bank Canonical Correlation Analysis (FBCCA) algorithm
- erd / ers: Basic Event-Related (De)Synchronization (i.e. motor imagery) Detection
- Write an explanatory article that also can serve as a proof-of-concept (June 1st, 2022)
- Plug in Webgazer to detect where the user is looking on the screen.
- Implement Filter Bank Canonical Correlation Analysis (FBCCA) in hightime
- Test FBCCA algorithm on a single flashing stimulus
- Implement P300 detection in potentials with all the signal processing in hightime
- Test P300 detection on a single flashing stimulus
- Test both algorithms on various EEG devices
- Test both algorithms on a Chromebook
- Test both algorithms with multiple stimuli to discriminate from
- Design a navigation scheme (i.e. Web Components) that can use the algorithms to navigate a webpage
- Design a Chrome Extension that allows for generic web browsing
- Implement auditory BCI methods too!
- ssvep: Detect SSVEP on the browser
- potentials: Detect ERPs on the browser
- webgazer: Scalable Webcam EyeTracking Using User Interactions
- datastreams-api: Get raw data on the browser