feat: Add benchmarks#7

Merged

Pringled merged 15 commits into

mainfrom

semble-benchmarks

Apr 15, 2026

Commits on Apr 14, 2026

Add benchmarks directory with cleaned-up bench_hybrid
Pringled
committed

Commits on Apr 15, 2026

Fix benchmark review: decouple common from semble, skip missing repos in load_tasks, compute ndcg5 in cache mode
Pringled
committed
Address code review: fix language table, ndcg5 in cache mode, raw shadowing, asserts, redundant slice
Pringled
committed
Architecture review: remove dead code, fold helpers, pass specs, clean up common.py
Pringled
committed
Simplification pass: inline helpers, remove dead fields, merge summary functions
Pringled
committed
Rename bench_hybrid.py to run_benchmark.py
Pringled
committed
Add docstrings to benchmarks and enforce with ruff
Pringled
committed
Inline count_indexed_targets, pre-group by_language in _print_summary
Pringled
committed
Drop from __future__ import annotations where not needed
Pringled
committed
Save benchmark results to benchmarks/results/<sha>.json
Pringled
committed
Replace cache benchmark with index_ms tracking per repo
Pringled
committed
Add benchmark results for 92176df
Pringled
committed
Add trailing newline to saved results JSON
Pringled
committed
Rename common.py to data.py, move BENCH_ROOT to ~/.cache/semble-bench, inline _output
Pringled
committed
Add benchmark results for 40a7692
Pringled
committed