Home

Hydra-Inference Wiki

Mixed-vendor GPU inference cluster manager using llama.cpp RPC.

Pages

• Architecture — How the cluster works, data flow, and design decisions
• Hardware Setup — Building llama.cpp for CUDA/ROCm workers and coordinator
• Configuration — cluster.yaml reference and examples
• CLI Reference — All commands and options
• Troubleshooting — Common issues and fixes
• Network Optimization — Bandwidth tuning and layer placement
• OpenClaw Integration — Registering Hydra as an OpenClaw provider

Quick Links

• llama.cpp RPC docs
• Cross-vendor RPC confirmation