Repository navigation
v0.2.0
v0.2.0 — Prometheus, Replay, Benchmarks, Scheduling & Alerts
New Features
- Prometheus
/metrics— exposesllm_requests_total,llm_tokens_total,llm_tps_last,llm_ttft_ms_last,llm_duration_ms_lastwith per-model labels - Request Replay — replay any captured request from the detail modal; result displayed inline
- Session Grouping — dashboard shows active sessions grouped by client IP with request/model counts
- Benchmark Suite — context-scaling, parallel-scaling, and combined matrix load tests with tables, Recharts, and LLM-generated summary reports
- Benchmark Comparison — select two runs and view side-by-side LLM reports
- Benchmark Scheduling — cron presets (5m, 15m, 30m, hourly, daily, weekly) with background scheduler goroutine
- Alert Thresholds — configurable metric thresholds (TPS, TTFT, duration) with operator, value, and optional model filter; live checking on each poll
- Settings Tab — UI for managing alert thresholds and viewing triggered alerts
- Client IP & Duration — captured on every request, shown in cards and detail modal
- Tab Routing — hash-based routes so refreshing or sharing a URL preserves the active tab
- Stylized Dropdowns — custom
Selectcomponent shared across model picker, schedule form, and alert threshold form - Grid/List Toggle — benchmark runs can be viewed as a grid or list
Improvements
- Orphaned benchmark runs are marked
failedon server restart - Benchmark form pulls models from the active provider service
- Scroll fix for benchmark detail view (overflow-y wrapper)
- SVG logo and favicon
- Shared
Selectcomponent extracted for consistent UI
Bug Fixes
CheckAlertsno longer returns JSONnull(was crashing the frontend withCannot read properties of null (reading 'length'))
Chores
- MIT license
- Full CI/CD workflows (ci.yml, release.yml)
- Updated README with all features, flags, and architecture
.gitignoreupdated- SEO meta tags in
index.html
What's Changed
- feat: add benchmark suite, Prometheus metrics, alert thresholds, and … by @codewithwest in #1
New Contributors
- @codewithwest made their first contribution in #1
Full Changelog: v0.1.0...v0.2.0
What's Changed
- feat: add benchmark suite, Prometheus metrics, alert thresholds, and … by @codewithwest in #1
New Contributors
- @codewithwest made their first contribution in #1
Full Changelog: v0.1.0...v0.2.0