feat: restore cross-language benchmark suite (ILO-65)#608
Merged
Conversation
Codecov Report✅ All modified and coverable lines are covered by tests. 📢 Thoughts on this report? Let us know! |
Add bench/ directory with five canonical benchmarks (fib, hof, listproc, pattern-match, sum-loop) each implemented in ilo + Python / Node.js / Rust. bench/run.sh runs all impls, verifies correctness, and emits bench/results.json. CI nightly workflow (.github/workflows/bench.yml) runs the suite and gates on >10% regression vs previous run. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
danieljohnmorris
force-pushed
the
chore/benchmark-suite-restore
branch
from
91b2b69 to
72a5469
Compare
This was referenced May 22, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
bench/at repo root with five canonical benchmarks: fib, hof, listproc, pattern-match, sum-loopbench/run.shruns all impls, verifies ilo correctness, emitsbench/results.json.github/workflows/bench.ymlruns nightly, commits updated results, and warns on >10% regressionWhat was restored vs rebuilt
The original
research/bench/run.sh(1669 lines, removed in commit1d4fb21) andresearch/explorations/bench-realistic/(removed in2f69316) were recovered from git history. The five benchmarks specified in ILO-65 (fib, hof, listproc, pattern-match, sum-loop) were extracted and adapted to the current ilo syntax (braceless guards for early return; inline lambdas required formap/flt/fld; explicit function-name arg for multi-function files).Test plan
bash bench/run.sh --no-rustruns end-to-end and producesbench/results.jsonbash bench/run.shcompiles and runs Rust baselinesFollow-ups
bench/results.json—site/src/content/docs/docs/perf.mdnot yet wired upCloses ILO-65
🤖 Generated with Claude Code