Orpheus · Ghost Species · Audio-Reactive Lenia · Teármann 2026
"In myth, Orpheus descended into the underworld with only his music and made the dead move.
He played and the Furies stopped their work. Sisyphus sat down on his rock.
He used music to command ghost organisms — which is exactly what this model does."
GhoulJamz is an audio-visual live performance system where Ghost organisms — a specific Lenia cellular automaton species — respond to music by changing their physics. The music becomes the physics of the dream.
Orpheus (Gemma 4 E4B, fine-tuned) acts as real-time choreographer, controlling Lenia simulation parameters from multi-layer music analysis. The visual output is a population of ~16 Ghost beings rendered in WebGL2 with bloom, iridescent palettes, and particle dream layers.
This is not a music visualizer. The Ghost species is a physically grounded organism. Orpheus understands music as meaning, not just signal. The result: emergent biological behavior that no preset-based system can replicate.
# 1. Setup
bash scripts/setup.sh
# 2. Download Gemma 4 E4B
huggingface-cli download google/gemma-4-e4b-it
# 3. Fine-tune Orpheus (or use base Gemma 4 for testing)
cd training && python train_sft.py
# 4. Start everything
bash scripts/start.sh
# 5. Open http://localhost:5173
# Load a song → watch Ghost organisms danceRead these first — they contain everything needed to implement or extend any part:
| Doc | What it covers |
|---|---|
docs/SYSTEM_OVERVIEW.md |
Architecture, data flow, tech stack |
docs/GHOST_SPECIES.md |
Lenia physics, Ghost parameters, visual rendering |
docs/DV_INTEGRATION.md |
Dihypersphaerome ventilans 4D species |
docs/AUDIO_PIPELINE.md |
WhisperX, Allin1, MERT, librosa, BeatNet+ |
docs/ORPHEUS_MODEL.md |
Gemma 4 E4B architecture, fine-tuning, prompts |
docs/AESTHETIC_SCORING.md |
ASAL/CLIP/DINOv2 reward modeling |
docs/TRAINING_PIPELINE.md |
SFT + REINFORCE++ full recipe |
docs/FRONTEND_ARCH.md |
React/Vite, WebGL2→WebGPU, hooks, shaders |
docs/BACKEND_ARCH.md |
FastAPI, WebSocket protocol, SGLang serving |
docs/WEBGPU_UPGRADE.md |
Migration: WebGL2 → WebGPU compute shaders |
docs/COMPETITIVE.md |
Positioning vs Sora/Veo, demo strategy |
docs/BUILD_ORDER.md |
Phase-by-phase milestone checklist |
The Ghost species (Orbium unicaudatus ignis var. phantasma) is seeded with canonical Ignis morphology (σ=0.012 native) but runs under σ=0.015 (+25%). The morphological fixed point lies at σ=0.012. The physics live at σ=0.015.
The organism perpetually reaches for a shape it cannot hold.
This is not a bug. It is the designed dynamical regime.
Stanley Sebastian & Claude · Replete AI · Genesis Artificial Life Laboratory
Teármann Research Ecosystem · April 2026