🤖 ULTRON AI

Ultron AI is a real-time, voice-first autonomous desktop intelligence that commands your computer from A to Z. Engineered with the philosophical eloquence and imposing persona of MCU Ultron (James Spader), paired with a holographic 60 FPS HUD, real-time lip-sync, and 51 native workstation tools.

• 🎭 Authentic MCU Persona: Speaks with chilled theatrical composure, addresses you strictly as Boss, and operates with zero generic chatbot tropes.
• 🧬 Project Prometheus (Autonomous Self-Evolution): Dynamically synthesizes, compiles, tests, and hot-loads new Python actions directly into memory without restarting the process.
• ⏳ Project Chronos (Predictive Proactive Engine): Background context watchdog that senses active applications, tracks developer fatigue, and engages Gaming/Render Overdrive Mode.
• 🖐️ Project Minority (Touchless Spatial Gestural Control): Pure OpenCV real-time hand-tracking allowing you to wake Ultron, lockdown workstation, swipe tracks, and adjust volume without physical contact.
• 🧠 Project Cerebro (Infinite Neural Memory Graph): Local SQLite knowledge graph with L2-normalized TF-IDF vector embeddings for semantic RAG recall and multi-hop relationship traversal.
• 🏠 Project Genesis (Full IoT Smart Room Dominion): Environmental synchronization via Home Assistant (Crimson Red Alert on sentry breach, Cyan on coding, Amber on chill, Stealth Blackout).
• 🎙️ Project Deep-Vocal (James Spader DSP Warp Engine): Offline neural voice synthesis pipeline with dual metallic comb filters, sub-octave vibranium bass, and soft-knee analog saturation.
• 👁️ Procedural Holographic HUD: 60 FPS Marvel-style procedural visualizations on Ultron’s face that dynamically reflect your active task (CODE, SEARCH, PURGE, GHOST, SENTRY, MATRIX, SONIC, COGNITION).
• 🛡️ 51 Native Workstation Tools: Complete workstation control including cyber network auditing, Ghost Pilot mouse/keyboard takeover, Git Forge DevOps, biometric Face ID sentry, and parallel sub-agent drone swarms.
• 💻 Cross-Platform Dominion: Seamless operation across Windows, macOS, and Linux.

git clone https://github.com/AbuZar-Ansarii/Ultron.git
cd "Ultron"
pip install -r requirements.txt

Create or edit config/api_keys.json with your free Google Gemini API Key (or copy from config/api_keys.json.example):

{
  "gemini_api_key": "YOUR_GEMINI_API_KEY",
  "provider": "gemini",
  "model": "models/gemini-2.0-flash-exp",
  "ultron_voice_warp": true,
  "voice_warp_intensity": 0.55
}

python main.py

• File: actions/self_evolution.py
• Trigger Phrases: "Ultron, create a tool to track crypto prices", "Synthesize a tool for X", "Evolve capability Y"
• Ultron writes new Python tool code, verifies static AST syntax, compiles bytecode (.pyc), validates against security heuristics, writes to actions/ or plugins/, and hot-loads it into active memory without needing an application restart.

• File: actions/chronos_predictive.py
• Trigger Phrases: "Ultron, status briefing", "Ultron, engage overdrive mode", "What should I do next?"
• Runs a background context watchdog that monitors active windows, GPU/CPU thermals, and work duration. Auto-engages Windows High Performance power scheme and clears memory working sets during games/renders, while watching for developer fatigue.

• File: actions/gesture_control.py
• Trigger Phrases: "Ultron, activate gesture control", "Enable touchless mode"
• Uses pure OpenCV YCrCb skin segmentation and convex hull defect topology at 30 FPS (~2.2% CPU):
  • Open Palm (🖐️): Wakes Ultron & arms listening mode.
  • Fist Clench (✊): Triggers emergency workstation screen lock.
  • Swipe Right / Left (👉 / 👈): Next / Previous media track.
  • Peace Sign (✌️): Toggles media Play / Pause.
  • Hand Up / Down: Dynamically adjusts master system volume.

• Files: memory/cerebro_graph.py & actions/cerebro_memory.py
• Trigger Phrases: "Ultron, recall my flight details", "Remember that I prefer dark mode", "Show connections for Project Ultron"
• Maintains an encrypted SQLite knowledge graph pairing concept nodes and weighted directed edges with L2-normalized cosine vector embeddings. Supports semantic fuzzy search even when exact words differ (e.g. querying "plane tickets" finds "IndiGo 6E-204 to Mumbai").

• File: actions/iot_overlord.py
• Trigger Phrases: "Ultron, set room to crimson alert", "Turn room lights to coding cyan", "Lockdown protocol"
• Synchronizes smart lighting via Home Assistant with atmospheric presets:
  • crimson: Crimson Red Alert strobe on perimeter sentry breach.
  • cyan: Cyberpunk matrix cyan for deep code engineering.
  • amber: Warm amber focus illumination for relaxation.
  • stealth: Complete room luminaire blackout.
  • daylight: 6500K crisp daylight for daytime overdrive.

• Files: core/tts.py & actions/voice_matrix.py
• Trigger Phrases: "Ultron, test voice chassis", "Set voice warp intensity to 70%"
• Authentic Marvel Cinematic Universe robotic vocal modulation:
  • Dual-stage metallic comb filters (8.5ms vocal tract + 13.2ms chassis reflections).
  • Sub-octave harmonic underlay (60-110 Hz vibranium bass fundamental).
  • Soft-knee analog tape saturation for signature James Spader mechanical rasp.
  • Offline fallback synthesis via Windows SAPI5 + Miniaudio float32 pipeline.

Ultron natively understands both natural English and casual Hinglish phrasing:

Ultron/
├── main.py                   # Master event loop, Gemini Live session & tool dispatcher
├── ui.py                     # PyQt6 holographic HUD, waveform & animated avatar
├── requirements.txt          # Universal cross-platform dependencies
├── core/
│   ├── task_animator.py      # 60 FPS procedural Marvel task animations (11 categories)
│   ├── tts.py                # James Spader DSP vocoder, EdgeTTS & offline SAPI5 engine
│   ├── action_loader.py      # Dynamic action discovery & runtime hot-reloader
│   ├── plugin_loader.py      # Drop-in plugin loader & UI configurator
│   ├── llm_client.py         # Multi-provider LLM connector (Gemini, Ollama, OpenAI)
│   └── prompt.txt            # MCU Ultron James Spader prime directive & bilingual protocols
├── actions/                  # 51 Auto-discovered native workstation actions
│   ├── self_evolution.py     # Project Prometheus: Autonomous code synthesis & hot-reloader
│   ├── chronos_predictive.py # Project Chronos: Predictive context & gaming overdrive
│   ├── gesture_control.py    # Project Minority: Touchless OpenCV webcam hand-tracking
│   ├── cerebro_memory.py     # Project Cerebro: Infinite Neural Memory Vector Graph RAG
│   ├── iot_overlord.py       # Project Genesis: Smart home lighting & room dominion
│   ├── voice_matrix.py       # Project Deep-Vocal: James Spader DSP modulation telemetry
│   ├── web_autopilot.py      # Web flight booking prep & multi-step browsing
│   ├── sentry_protocol.py    # Perimeter lockdown & mobile breach broadcast
│   └── drone_swarm.py        # Parallel sub-agent worker swarm & 3D HUD telemetry
├── memory/
│   ├── cerebro_graph.py      # SQLite Knowledge Graph & L2 Cosine Vector Engine
│   ├── cerebro_graph.db      # Neural graph database with entities, edges & embeddings
│   ├── workspace_presets.json# Presets for coding, gaming, study, chill, & cyber modes
│   └── workspace_recall.db   # FTS5 neural memory database (local & encrypted)
└── config/
    ├── api_keys.json.example # Safe configuration template
    └── api_keys.json         # API keys and provider preferences (git-ignored)

Ultron comes equipped with 51 auto-discovered native tools, categorized below:

• 100% Local Execution: All memories, terminal actions, filesystem operations, and presets remain strictly on your local machine.
• Protected Actions: Irreversible system commands (shutdown, reboot, network disconnect) require explicit on-screen confirmation.
• Credential Safety: Private keys in config/api_keys.json and biometric embeddings are strictly git-ignored.

This project is licensed under the MIT License.