Skip to content

v0.2.0

Choose a tag to compare

@codewithwest codewithwest released this 26 Jun 14:14
· 12 commits to main since this release

v0.2.0 — Prometheus, Replay, Benchmarks, Scheduling & Alerts

New Features

  • Prometheus /metrics — exposes llm_requests_total, llm_tokens_total, llm_tps_last, llm_ttft_ms_last, llm_duration_ms_last with per-model labels
  • Request Replay — replay any captured request from the detail modal; result displayed inline
  • Session Grouping — dashboard shows active sessions grouped by client IP with request/model counts
  • Benchmark Suite — context-scaling, parallel-scaling, and combined matrix load tests with tables, Recharts, and LLM-generated summary reports
  • Benchmark Comparison — select two runs and view side-by-side LLM reports
  • Benchmark Scheduling — cron presets (5m, 15m, 30m, hourly, daily, weekly) with background scheduler goroutine
  • Alert Thresholds — configurable metric thresholds (TPS, TTFT, duration) with operator, value, and optional model filter; live checking on each poll
  • Settings Tab — UI for managing alert thresholds and viewing triggered alerts
  • Client IP & Duration — captured on every request, shown in cards and detail modal
  • Tab Routing — hash-based routes so refreshing or sharing a URL preserves the active tab
  • Stylized Dropdowns — custom Select component shared across model picker, schedule form, and alert threshold form
  • Grid/List Toggle — benchmark runs can be viewed as a grid or list

Improvements

  • Orphaned benchmark runs are marked failed on server restart
  • Benchmark form pulls models from the active provider service
  • Scroll fix for benchmark detail view (overflow-y wrapper)
  • SVG logo and favicon
  • Shared Select component extracted for consistent UI

Bug Fixes

  • CheckAlerts no longer returns JSON null (was crashing the frontend with Cannot read properties of null (reading 'length'))

Chores

  • MIT license
  • Full CI/CD workflows (ci.yml, release.yml)
  • Updated README with all features, flags, and architecture
  • .gitignore updated
  • SEO meta tags in index.html

What's Changed

  • feat: add benchmark suite, Prometheus metrics, alert thresholds, and … by @codewithwest in #1

New Contributors

Full Changelog: v0.1.0...v0.2.0

What's Changed

  • feat: add benchmark suite, Prometheus metrics, alert thresholds, and … by @codewithwest in #1

New Contributors

Full Changelog: v0.1.0...v0.2.0