This is the handbook for the LLM Operations team. It is a living document.
For the rendered version, visit our website: https://llmops-handbook.distantmagic.com/
- Paddler - Stateful load balancer custom-tailored for llama.cpp
- Resonance - Modern PHP framework for IO-intensive applications
Creative Commons Attribution Share Alike 4.0 International
Discord: https://discord.gg/kysUzFqSCK