localperf v0.1.0

First release of localperf, a local LLM inference benchmark CLI for vLLM-managed runs.

Highlights

• Verified context labels: every workload declares context_target/context_semantics; specs that conflate server capacity with active context are refused before GPU time, and reports label rows only by declared-and-measured active context or the measured token shape — never by max_model_len alone.
• localperf sweep plan: generates the default context/concurrency sweep grid with contract-compliant shapes; generated specs are guaranteed to validate.
• Model-level artifacts: bench run --artifact appends repeated runs of one model into a single SQLite file; artifact merge --into combines existing artifacts idempotently with provenance-checked collision refusal.
• Complete metrics: token-weighted ITL alongside request-weighted TPOT, TTFT/latency p50/p95/p99, RPS, achieved concurrency, failure breakdowns, repeat aggregation with mean ± spread, and optional SLO-based goodput.
• Capture layer: hardware inventory, GPU utilization/memory sampled from all available sources (tegrastats, nvidia-smi), and engine identity probes that verify the served model against the spec.
• Standalone HTML reports rendered from the SQLite artifact, with a generated metric legend; every displayed number is re-derivable from stored raw data.
• Conservative memory safety: MemAvailable floors enforced before and during every step.

Install

Download a binary below, or:

go install github.com/dutifuldev/localperf/cmd/localperf@v0.1.0

Binaries: linux/amd64, linux/arm64, darwin/amd64, darwin/arm64 (pure Go, no CGO).