Skip to content

DevStudio-AI/VybePixie

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

8 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

VybePixie Banner

VybePixie

Built with VybeCoder Execution Verified

AI-Native Game & Animation Studio

A complete AI-powered creative studio that covers the entire pipeline — from natural language prompts to playable games and animated content. Describe what you want in plain English, and VybePixie generates 3D worlds, animated characters, game logic, audio, and exports to Godot, Unity, or Unreal Engine. Not just an asset generator — a full production environment.

Platforms Game Engines DCC Bridges Rendering AI Audio


What It Actually Is

VybePixie is an AI-native game and animation studio that handles every stage of production:

Prompt → Game Design → 3D Assets → Animation → Audio → Game Logic → Playable Export

Describe a game in plain English. VybePixie's multi-agent system writes the game spec, generates 3D characters and environments, animates them, composes music and voice, wires up physics and game logic, and exports a playable project to Godot 4, Unity, or Unreal Engine 5.

The same pipeline works for standalone animation, cinematic sequences, and individual asset creation — but the full-game workflow is the headline capability.

What Makes It Different

  • Prompt-to-Game — One prompt, playable output. Not just assets — complete games.
  • Multi-Agent Orchestration — Director, Producer, and Technical Director AI agents collaborate on every project
  • Full Animation Studio — Locomotion, combat, facial, ragdoll, mocap retargeting, IK, secondary physics
  • Integrated Audio — AI voice synthesis, AI music composition, procedural soundscapes
  • Event-Sourced Determinism — Same input = same output, every time. Cryptographic proof of every decision.
  • Multi-Engine Export — Godot 4, Unity, Unreal Engine 5, Blender as first-class export targets

Core Capabilities

🎮 Game Design & Development

Feature Description
Prompt-to-Game Pipeline Describe a game in natural language, get a playable export
Agent Game System Agentic workflow: writes specs → generates assets → composes scenes → exports to engine
Game Scene Composition Level building, spatial layout, performance optimization
Game Logic State machines, behavior trees, input systems, HUD/UI generation
Multiplayer Foundation Networking framework for multiplayer game exports
Physics Systems Rigid body, character controller, world-scale, ragdoll physics

🎬 Animation Studio

Full character animation pipeline — not just idle loops:

Category Animations
Locomotion Walk, run, sprint, sneak, climb, swim, fly
Idle Breathing, fidget, look-around, sit, sleep
Combat Attack, block, dodge, hit-react, death, combo chains
Emote Wave, cheer, dance, taunt, bow, applaud
Interaction Grab, carry, throw, push, pull, use-item
Facial Blendshape-driven expressions, lip sync, eye tracking
Procedural IK-driven, physics-based, environment-reactive

Style Variations: Neutral, Aggressive, Relaxed, Energetic, Sneaky, Nervous, Confident — each animation category has personality variants.

Advanced Animation Systems:

  • Blend Trees & State Machines — Smooth transitions between animation states
  • Inverse Kinematics — Limb IK solver for foot placement, hand targeting, look-at
  • Motion Capture Integration — Mocap data import, processing, and retargeting
  • Secondary Animation — Spring bones, jiggle physics, cloth simulation, tails, wings, hair
  • Ragdoll Physics — Full physics-driven character animation
  • Animation Events — Frame-triggered gameplay actions

🧑‍🎨 Character & Creature Creation

System Description
Archetype Templates Fantasy, Sci-Fi, Modern, Historical character bases
Non-Human Characters Creatures, Robots, Aliens, Monsters with full rigging
Faction System Faction-based character grouping and visual identity
Crowd Generation NPC population at scale with variation

🌍 3D World Building

System Description
Procedural Terrain Heightmap generation with hydraulic erosion simulation
Architecture Generation AI-generated buildings, interiors, and structural layouts
Environment Generation Landscapes, biomes, weather-appropriate vegetation
Scatter Systems Foliage, props, and population distribution
L-Systems Procedural plants, trees, and organic structures
Signed Distance Fields SDF-based 3D shape sculpting
Lighting System Dynamic lighting and baked lightmaps
Camera System Cinematic shot composition and framing
LOD Generation 4 LOD levels + billboard auto-generation

🖼️ Rendering

Feature Description
Real-Time Renderer GL/ANGLE-based live viewport for instant preview
Path Tracer CPU/GPU ray tracing for photorealistic final output
Post-Processing Bloom, depth of field, motion blur, color grading, tone mapping
HDR Color Management sRGB, linear, ACEScg color space pipeline
XR/AR/VR Support WebXR, ARKit, ARCore, Meta Quest export targets

🔊 Audio Generation

Feature Description
Voice Synthesis Multi-speaker TTS with voice selection and personality
Music Generation AI-composed background music matching scene mood
Ambient Soundscapes Procedural environment audio (forest, city, dungeon, ocean)
Audio Effects Granular synthesis, modulation, spatial mixing

🤖 AI Director & Multi-Agent Orchestration

Agent Role
Director Creative vision, scene composition, quality standards
Producer Budget tracking, cost-per-generation, resource allocation
Technical Director Pipeline optimization, format selection, performance tuning

Orchestration Features:

  • Intent Parsing — Natural language to technical parameters
  • Critique & Refinement Loops — Iterative quality improvement cycles
  • Budget-Aware Decision Making — Cost tracking and optimization per generation
  • Strategy Selection — Multiple generation approaches evaluated per task
  • Multi-LLM Routing — Anthropic Claude, OpenAI GPT-5, Google Gemini, xAI Grok, DeepSeek, ZhipuAI GLM

📦 Asset Pipeline

Feature Description
Content-Addressable Registry Provenance and lineage tracking for every asset
Non-Destructive Editing Layer-based edits with full undo/redo history
External Asset Ingestion Import with attribution and license checking
Format Conversion EXR, PNG, JPEG, WebP, GLB/GLTF, FBX, OBJ, USD, USDZ, VRM

Third-Party Integrations

3D Generation APIs

Service Capabilities
Meshy API v2 Text-to-3D, Image-to-3D, Multi-Image-to-3D
Tripo3D Alternative text-to-3D provider
Luma AI Image-to-3D generation

Image Generation

Service Capabilities
OpenAI DALL-E AI image synthesis for textures and concepts
Stability.ai Stable Diffusion API for PBR materials

Audio APIs

Service Capabilities
ElevenLabs Voice synthesis for character dialogue
PlayHT Alternative TTS provider
Suno AI music generation
Udio Alternative music composition

LLM Providers

Provider Models
Anthropic Claude 4.x series
OpenAI GPT-5 series
Google Gemini 3.x
xAI Grok 4.x
DeepSeek Chat, Coder, Reasoner
ZhipuAI GLM 4.x series

Game Engine Exporters

Engine Export Type
Godot 4.x Full playable project with scenes, scripts, and assets
Unity Complete Unity project with URP/HDRP materials
Unreal Engine 5 Full UE5 project with Blueprints and materials
Blender .blend files + real-time DCC bridge

DCC Tool Bridges

Tool Integration
Blender Full real-time bi-directional sync
Maya Rigging, animation, and asset export
Houdini Procedural content pipeline
3DS Max Legacy pipeline support

Architecture Overview

VybePixie is a Tauri hybrid desktop application — a Rust-powered native container hosting a React frontend, backed by a Python engine for AI generation, game logic, animation, audio, and 3D processing.

┌──────────────────────────────────────────────────────────────┐
│                    Tauri Desktop Container                    │
│            (Rust · Secure sandboxing · IPC bridge)           │
├──────────────────────────┬───────────────────────────────────┤
│                          │                                    │
│   React Frontend         │        Rust Backend                │
│   (src/)                 │        (src-tauri/)                │
│                          │                                    │
│   • Three.js 3D viewport │        • File system access        │
│   • Real-time + path     │        • Process management        │
│     trace rendering      │        • Native dialogs            │
│   • 15+ workspace panels │        • Shell commands             │
│   • Animation timeline   │        • Security sandboxing        │
│   • Game systems editor  │                                    │
│   • Storyboard           │                                    │
│                          │                                    │
└──────────────────────────┴───────────────────────────────────┘
              │                              │
              └──────────┬───────────────────┘
                         ▼
          ┌──────────────────────────────┐
          │    Python Backend Engine     │
          │    (localhost:8001)          │
          │                              │
          │  Event-Sourced Core          │
          │  ├── 12 Phase System         │
          │  ├── Deterministic Replay    │
          │  ├── Event Ledger (SQLite)   │
          │  └── State Reconstruction    │
          │                              │
          │  AI Multi-Agent System       │
          │  ├── Director Agent          │
          │  ├── Producer Agent          │
          │  └── Technical Director      │
          │                              │
          │  Game Pipeline               │
          │  ├── Prompt-to-Game          │
          │  ├── Scene Composition       │
          │  ├── Game Logic Generation   │
          │  └── Multi-Engine Export     │
          │                              │
          │  Animation Engine            │
          │  ├── Blend Trees & FSMs      │
          │  ├── IK / Ragdoll / Mocap    │
          │  ├── Facial Animation        │
          │  └── Secondary Physics       │
          │                              │
          │  Audio Generation            │
          │  ├── Voice Synthesis         │
          │  ├── Music Composition       │
          │  └── Ambient Soundscapes     │
          │                              │
          │  3D Generation Pipeline      │
          │  ├── Text/Image-to-3D        │
          │  ├── Texture Diffusion       │
          │  ├── Procedural Generation   │
          │  └── GPU Orchestration       │
          │                              │
          │  DCC Bridges                 │
          │  ├── Blender (real-time)     │
          │  ├── Maya · Houdini          │
          │  └── 3DS Max                 │
          └──────────────────────────────┘

12-Phase Engine Architecture

Phase System Purpose
0 Core & Event Ledger Hashing, IDs, events, determinism foundation
1 World Model Scene graph, nodes, transforms
2 Asset Registry Content-addressable storage, versioning
3 Edit System Non-destructive edits, undo history
4 Planning Agent budgets, task decomposition
5 Generation AI pipelines with cost tracking
6 Assembly Scene building, LOD, linking
7 Validation 50+ rules, budget enforcement
8 Fixes Auto-fix engine, governance gates
9 Procedural 50+ generation algorithms
10 Director Multi-agent LLM orchestration
11 Ingestion Data import, gap detection
12 DCC Bridges Blender, Maya, Houdini, 3DS Max sync

Full architecture deep-dive in ARCHITECTURE.md


Tech Stack

Layer Technologies
Desktop Tauri 2.9 (Rust 2021 edition)
Frontend React 18, Three.js, Redux Toolkit, Tailwind CSS, Vite
3D @react-three/fiber, @react-three/drei, path tracer, real-time renderer
Backend Python 3.11+, FastAPI, Pydantic 2, SQLAlchemy 2 (async)
AI/ML PyTorch 2.1+, Diffusers, Transformers, xformers
API GraphQL (Strawberry), REST, WebSocket
Audio ElevenLabs, PlayHT, Suno, Udio
Task Queue Celery + Redis
Storage SQLite (event ledger), PostgreSQL (API data)
Game Engines Godot 4, Unity, Unreal Engine 5
Testing Vitest (frontend), pytest (backend)

Full breakdown in TECH_STACK.md


Workspace UI

15+ dockable panels in a professional editing environment:

┌──────────────────────────────────────────────────────────────┐
│  Menu Bar  │  Toolbar (modes, view controls, render mode)    │
├────────────┼──────────────────────────────┬──────────────────┤
│            │                              │                  │
│  Scene     │    3D Viewport               │  Properties      │
│  Graph     │    (Real-Time / Path Trace)  │  Inspector       │
│  Panel     │                              │                  │
│            │                              ├──────────────────┤
│            │                              │  Asset           │
│            │                              │  Browser         │
├────────────┴──────────────────────────────┴──────────────────┤
│  Timeline / Animation Editor  │  AI Chat  │  Game Systems    │
└───────────────────────────────┴───────────┴──────────────────┘
Panel Purpose
Director Scene hierarchy and composition
Assets Content library browser
Preview Live 3D viewport (real-time + path trace)
Validation QA checks with auto-fix
Export Engine export configuration (Godot/Unity/UE5)
AgentGame Full game creation workflow
AI Chat Natural language assistant
AI 3D Generation Mesh generation interface
Timeline Animation editor with blend trees
Storyboard Narrative and scene planning
Game Systems Mechanics, physics, input configuration
Multiplayer Networking setup
Properties Node/asset property editor
API Key Settings Per-provider credential management
Cost Settings Budget tracking and limits

Security Model

Feature Implementation
Tauri sandboxing Rust-enforced security boundary between web and native
Content Security Policy Strict CSP prevents unauthorized resource loading
File system isolation Controlled FS access through Tauri permission system
Tamper-proof history Blockchain-style hash chaining on event ledger
RBAC Role-based access for multi-user/studio environments
Audit trail Every creation, edit, and export is logged
AI governance Generation passes through validation before acceptance

Full security details in SECURITY.md


Project Status

VybePixie is in active development. Core systems are functional:

  • ✅ Event-sourced deterministic core (12-phase system)
  • ✅ Tauri desktop application with 15+ workspace panels
  • ✅ Prompt-to-Game pipeline with multi-engine export
  • ✅ Full animation studio (locomotion, combat, facial, ragdoll, IK, mocap)
  • ✅ AI audio generation (voice, music, soundscapes)
  • ✅ Real-time renderer + path tracer
  • ✅ Character & creature creation with archetype system
  • ✅ Procedural world building (terrain, architecture, vegetation)
  • ✅ Multi-agent AI orchestration (Director, Producer, TD)
  • ✅ 3D generation via Meshy, Tripo3D, Luma AI + self-hosted models
  • ✅ DCC bridges (Blender, Maya, Houdini, 3DS Max)
  • ✅ XR/AR/VR export (WebXR, ARKit, ARCore, Meta Quest)
  • ✅ 50+ procedural generation algorithms
  • ✅ Validation engine with auto-fix
  • 🔄 Studio beta preparation

How This Was Built

This project was built using VybeCoder — an execution-verified AI software system that plans, generates, debugs, and verifies complete applications.

Unlike traditional AI coding assistants that generate snippets and leave you to debug, VybeCoder manages the entire lifecycle: architecture decisions, multi-file coordination, error detection, automated repair, and runtime verification.

What does that mean in practice?

  • Every file was planned, generated, and tested through VybeCoder's build pipeline
  • Errors were caught and fixed automatically — not manually
  • The final output was verified to run, not just compile

Want to build something like this? Start building with VybeCoder — no coding experience required.


License

This repository contains documentation and architecture references only. The source code is proprietary and not publicly available.

© 2024-2026 DevStudio AI Inc. All rights reserved.

See LICENSE for details.

About

AI-native game & animation studio — prompt-to-playable-game pipeline with 3D generation, character animation, audio synthesis, and multi-engine export (Godot, Unity, UE5). Built with VybeCoder.

Topics

Resources

License

Security policy

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors