Skip to content

v0.1.0

Choose a tag to compare

@jungledesh jungledesh released this 14 Apr 19:15
· 192 commits to main since this release
db7429a

v0.1.0 — First release

  • Diagnose vLLM inefficiencies in seconds
  • Detects:
    • Under-batching
    • KV cache pressure
    • Low prefix cache reuse
  • Supports snapshot + duration analysis

Quick start:
./profile diagnose --url http://localhost:8000/metrics --duration 5m