v2.1.0 — Real Benchmark Engine

Real Benchmark Engine + Information Preservation

This release replaces the estimation-based benchmark with a real measurement engine that scans your project files and produces verifiable, shareable results.

New

• Project-wide benchmark (lean-ctx benchmark run [path]):

  • Scans up to 50 representative files across all languages
  • Measures real token counts per compression mode (map, signatures, aggressive, entropy, cache_hit)
  • Tracks wall-clock latency per operation
  • Computes AST-based preservation quality scores per mode
  • Session simulation: models a 30-min coding session with real numbers

• Three output formats:

  • lean-ctx benchmark run — ANSI terminal table
  • lean-ctx benchmark run --json — machine-readable JSON
  • lean-ctx benchmark report — shareable Markdown for GitHub/LinkedIn

• MCP ctx_benchmark extended with action=project parameter

Install

cargo install lean-ctx

Full changelog: https://github.com/yvgude/lean-ctx/blob/main/CHANGELOG.md

Full Changelog: v2.0.0...v2.1.0