Skip to content

moinsen-dev/ariapilot

Repository files navigation

AriaPilot 🧭

AI-powered voice assistant for web accessibility.
Works alongside your screenreader, not as a replacement.

License Chrome Extension Status


🎯 Mission

AriaPilot makes web navigation easier for blind and visually impaired users by providing intelligent voice-controlled automation for complex web tasks.

Not a screenreader replacement — it's an augmentation that works with JAWS, NVDA, and VoiceOver.


✨ Features

Voice Commands

  • 🎙️ "Show headlines" — Lists all headings on the page
  • 🔗 "Show links" — Lists all clickable links
  • 📝 "Show forms" — Identifies form fields
  • 🤖 "Summarize page" — AI-generated page summary
  • 🖱️ "Click [element]" — Simulates clicks

Smart Integration

  • ✅ Works alongside existing screenreaders
  • 🔒 Privacy-first (local processing by default)
  • ⚡ Keyboard shortcuts (Ctrl+Shift+V to toggle voice)
  • 🌐 Multi-language support (planned)

B2B Ready

Designed for institutions:

  • Vocational Rehabilitation Agencies
  • Universities (Disability Services)
  • Enterprise (ADA Compliance)

🏗️ Architecture

┌─────────────────────────────────────────┐
│     Chrome Extension (Manifest V3)      │
├─────────────────────────────────────────┤
│  Content Script  │  Background Service  │
│  • DOM queries   │  • Voice handling    │
│  • ARIA extract  │  • AI client         │
│  • Click sim     │  • State management  │
└─────────────────────────────────────────┘
                    │
    ┌───────────────┴───────────────┐
    ▼                               ▼
Local Mode (Default)        Cloud Mode (Opt-in)
• Web Speech API            • Claude/GPT-4 API
• Browser-only              • Anonymous structure only
• No data leaves device     • No passwords, no content

Tech Stack

  • Extension: Manifest V3, vanilla JS
  • Speech: Web Speech API
  • AI (local): Transformers.js / ONNX Runtime
  • AI (cloud): Claude API (optional)
  • Build: Vite

🚀 Getting Started

Installation (Development)

# Clone the repo
git clone https://github.com/moinsen-dev/ariapilot.git
cd ariapilot

# Install dependencies
npm install

# Build extension
npm run build

# Load in Chrome
1. Open chrome://extensions/
2. Enable "Developer mode"
3. Click "Load unpacked"
4. Select the `dist` folder

Usage

  1. Install the extension from Chrome Web Store (coming soon)
  2. Press Ctrl+Shift+V to toggle voice control
  3. Speak commands like "Show headlines"
  4. Listen to the response via your screenreader

📋 Roadmap

Phase 1: Foundation (Q1 2026)

  • Initial prototype
  • User interviews (3-5 blind users)
  • VR agency partnerships
  • Tech feasibility validation

Phase 2: MVP (Q2 2026)

  • Chrome Web Store release
  • 5 core voice commands
  • Screenreader integration
  • B2B pilot program

Phase 3: Scale (Q3-Q4 2026)

  • Local LLM integration
  • Multi-language support
  • Enterprise features (SSO, audit logs)
  • Mobile research (iOS/Android)

🤝 Contributing

We welcome contributions! See CONTRIBUTING.md for details.

Areas where help is needed:

  • 🎨 UI/UX design for accessibility
  • 🔊 Voice interaction research
  • 🧪 User testing with blind participants
  • 💼 B2B partnerships

📄 License

Copyright 2026 Moinsen Dev

Licensed under the Apache License, Version 2.0

This project is inspired by Chrome DevTools MCP by Google LLC (also Apache 2.0).

See ATTRIBUTION.md for details.


🙏 Acknowledgments

  • Chrome DevTools MCP team for the architectural inspiration
  • NV Access (NVDA) and Freedom Scientific (JAWS) for screenreader standards
  • Web Accessibility Initiative (WAI) for ARIA specifications

📞 Contact


Making the web accessible, one voice command at a time.

About

AI-powered voice assistant for web accessibility - Chrome Extension

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors