Skip to content

v0.12.2-beta — throughput-benchmark timing fix

Pre-release
Pre-release

Choose a tag to compare

View all tags
@joslat joslat released this 18 Jun 13:17
· 197 commits to main since this release
v0.12.2-beta
f103df6
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

v0.12.2-beta — patch release (green CI ✅)

A small, fully-verified patch on top of v0.12.1-beta.

Fixed

  • Throughput-benchmark timing (#54) — PerformanceBenchmark.RunThroughputBenchmarkAsync now measures the reported Duration with a high-resolution Stopwatch instead of DateTimeOffset.UtcNow (which has ~15.6 ms granularity on Windows). This improves Duration accuracy and removes an intermittent flake in the benchmark's timing assertion on the loaded net8.0/Windows CI leg. Requests-per-second was always correct — it divides by the configured measurement window, not wall-clock.

This release was cut on a fully green CI run (all 6 build/test legs across net8/9/10 on Linux + Windows).

📦 Install

dotnet add package AgentEval --prerelease                      # 0.12.2-beta
dotnet tool install --global AgentEval.Cli --prerelease

Full changelog: compare v0.12.1-beta...v0.12.2-beta

Assets 2
Loading