v0.5.2

himorime v0.5.2

Performance budgets and regression checks for command-line programs:
latency, throughput, CPU time and peak RSS. Every artifact is
signed and ships with an SBOM and build provenance; see
Verify a release.

Changelog

Documentation

• 8c8c3d0: docs: add the OpenSSF Scorecard badge to the README (@nao1215)
• 0c7a12e: docs: drop the offline claim for slsa-verifier (@nao1215)

Full changelog: v0.5.1...v0.5.2

v0.5.1

himorime v0.5.1

Performance budgets and regression checks for command-line programs:
latency, throughput, CPU time and peak RSS. Every artifact is
signed and ships with an SBOM and build provenance; see
Verify a release.

Changelog

Features

• c75e1e0: feat(bench): add C compilers third-party suite (@nao1215)
• ff077f9: feat(bench): add JavaScript runtimes third-party suite (@nao1215)
• cde8831: feat(bench): add awk interpreters third-party suite (@nao1215)
• 70f4719: feat(bench): add interactive shells third-party suite (@nao1215)
• 32cdf41: feat(bench): add sort third-party suite comparing GNU and uutils (@nao1215)

Bug fixes

• 869d107: fix(bench): look for the shell result anywhere in the terminal output (@nao1215)
• 8328095: fix(bench): pin TERM in the interactive shells suite (@nao1215)
• a338b24: fix(config): find the project root the way the run does (@nao1215)
• 35b57e7: fix(proc): let a stopped run win over the typing poll (@nao1215)

Documentation

• cd6a306: docs(bench): date the uutils sort switch to Ubuntu 25.10 (@nao1215)
• 4669336: docs: record the contributors list in .all-contributorsrc (#140) (@nao1215)
• f41ac7b: docs: state what every real-world suite shares once (@nao1215)

Full changelog: v0.5.0...v0.5.1

v0.5.0

himorime v0.5.0

Performance budgets and regression checks for command-line programs:
latency, throughput, CPU time and peak RSS. Every artifact is
signed and ships with an SBOM and build provenance; see
Verify a release.

Changelog

Bug fixes

• 01439e0: fix(cli): treat a suite whose file is missing from the base as new (@nao1215)
• a1cd560: fix(cli): write report --output the way run --output does (@nao1215)
• 054cd39: fix(config): reject extra documents and keep aliased values as written (@nao1215)
• 1aa23c2: fix(gitwt): prune only himorime's own orphaned worktree entries (@nao1215)
• 6ace6b6: fix(gitwt): remove a base worktree that holds read-only directories (@nao1215)
• 617c38b: fix(metric): reject durations that do not come to whole nanoseconds (@nao1215)
• f91153c: fix(metric): reject percentiles that round to p100 (@nao1215)
• 0412b4d: fix(report): accept section markers only at fence indentation (@nao1215)
• 6fa9625: fix(report): mark metrics without a successful run as failed (@nao1215)

Documentation

• f634dce: docs(changelog): record the loader, compare and report fixes (@nao1215)
• be5b8cd: docs(e2e): name atago v0.23.0 in the install hint (@nao1215)
• 246c936: docs: list the himorime-bin AUR package and credit its maintainer (@nao1215)

Others

• 9fd19b6: refactor(config): drop checks the schema already makes and cover pruning (@nao1215)

Full changelog: v0.4.1...v0.5.0

v0.4.1

himorime v0.4.1

Performance budgets and regression checks for command-line programs:
latency, throughput, CPU time and peak RSS. Every artifact is
signed and ships with an SBOM and build provenance; see
Verify a release.

Changelog

Features

• 9273e3c: feat(bench): add a third-party csv suite for Miller, qsv and xan (@nao1215)
• 46e2233: feat(bench): add a third-party diff suite for GNU diff and git diff (@nao1215)
• f858495: feat(bench): add a third-party sql over csv suite for DuckDB, trdsql, csvq and sqly (@nao1215)
• 6def850: feat(bench): add a third-party text search suite for GNU grep and ripgrep (@nao1215)
• 6a36efe: feat(bench): add a third-party tree copy suite for cp and rsync (@nao1215)
• d592d8f: feat(bench): add a third-party yaml to json suite for yq, yj and gojq (@nao1215)

Full changelog: v0.4.0...v0.4.1

v0.4.0

himorime v0.4.0

Performance budgets and regression checks for command-line programs:
latency, throughput, CPU time and peak RSS. Every artifact is
signed and ships with an SBOM and build provenance; see
Verify a release.

Changelog

Breaking changes

• 12589e8: feat(config)!: simplify suite fields while retaining version 1 (@nao1215)

Features

• 4374c6f: feat(cli): add TTY benchmark progress (@nao1215)
• a501fda: feat(cli): add saved report rendering (@nao1215)
• 1148960: feat(report): show compact verdicts before detailed statistics (@nao1215)

Bug fixes

• 17207f8: fix(bench): skip version RSS in the dogfood suite (@nao1215)
• a6aaabc: fix(report): include saved summary in markdown (@nao1215)
• 1a1b03d: fix(report): satisfy saved report lint (@nao1215)
• 723575c: fix(report): separate markdown summary (@nao1215)
• f661836: fix(test): preserve migrated budget ownership (@nao1215)
• ac8b5a1: fix: correct CLI contracts and document tool comparisons (@nao1215)
• 06f8b9d: fix: fail unassessed required budgets without dropping comparisons (@nao1215)

Documentation

• 19ef68a: docs: normalize cookbook file endings (@nao1215)
• c735f9f: docs: record first-run documentation changes (@nao1215)
• 2f0d42f: docs: shorten first-run guidance and split cookbook recipes (@nao1215)

Others

• 1ccab3c: Add GitHub downloads badge (@nao1215)
• 82a6c95: Merge remote-tracking branch 'origin/main' into docs/shorten-first-run (@nao1215)
• d26269a: Merge remote-tracking branch 'origin/main' into feat/simplify-suite (@nao1215)
• ec2e428: Merge remote-tracking branch 'origin/main' into refactor/compact-reports (@nao1215)
• 0dbea86: Merge remote-tracking branch 'origin/main' into verify/saved-reports (@nao1215)
• 0d1fbd1: refactor: classify diagnostics by their cause (@nao1215)

Full changelog: v0.3.0...v0.4.0

v0.3.0

himorime v0.3.0

Performance budgets and regression checks for command-line programs:
latency, throughput, CPU time and peak RSS. Every artifact is
signed and ships with an SBOM and build provenance; see
Verify a release.

Changelog

Features

• 7ad555e: feat(cli): recover diagnostic code implementation (@nao1215)
• b71544f: feat(prcomment): prioritize review decisions in benchmark reports (@nao1215)

Bug fixes

• 001d7be: fix(cli): complete diagnostic coverage without new options (@nao1215)
• da69608: fix(report): separate problem notifications from full Actions tables (@nao1215)
• f01d678: fix: preserve measurement selection and budget contracts (@nao1215)
• 2800743: fix: protect report destinations and retain hook diagnostics (@nao1215)
• 8628acc: fix: validate workflow run pull requests by repository ID (@nao1215)

Documentation

• 26ca7af: docs(report): explain problem-only comments and complete Actions logs (@nao1215)
• 24c0427: docs: consolidate diagnostics in the command reference (@nao1215)
• 650ea2b: docs: cover saved reports and measurement limits with existing workflows (@nao1215)
• af67519: docs: describe budget selection and report fixes (@nao1215)
• 6fa8e6a: docs: document action-owned benchmark notifications (@nao1215)
• e45c433: docs: enforce required budgets with existing JSON statuses (@nao1215)
• d1462bd: docs: explain review-focused benchmark comments (@nao1215)
• 8ba510b: docs: use latest himorime in comment workflow (#65) (@nao1215)

Others

• f02dd82: refactor: delegate PR comments to setup-himorime (@nao1215)
• 5f71231: refactor: remove helpers with no production callers (@nao1215)
• 0ccbf06: refactor: remove remaining test-only metric wrappers (@nao1215)

Full changelog: v0.2.2...v0.3.0

v0.2.2

What's Changed

• feat(bench): add compression tool comparison by @nao1215 in #61
• docs: streamline GitHub Pages by @nao1215 in #62
• feat(ci): post benchmark reports to pull requests by @nao1215 in #63
• chore: prepare v0.2.2 release by @nao1215 in #64

Full Changelog: v0.2.1...v0.2.2

v0.2.1

himorime v0.2.1

Performance budgets and regression checks for command-line programs:
latency, throughput, CPU time and peak RSS. Every artifact is
signed and ships with an SBOM and build provenance; see
Verify a release.

Changelog

Bug fixes

• e2a9cbc: fix(report): skip undefined reciprocal latency estimates (@nao1215)
• b993718: fix(report): skip unobservable memory comparisons (@nao1215)
• d7a8a53: fix(stats): reject undefined bootstrap base statistics (@nao1215)
• c98b783: fix: unify comparison inference and retain e2e diagnostics (@nao1215)

Documentation

• 9da7b48: docs: add himorime measurement badge (@nao1215)
• ba2e179: docs: define suite repository scope (@nao1215)
• 016c1e2: docs: explain zero-base bootstrap comparisons (@nao1215)
• 473fe24: docs: mark service-dependent commands out of scope (@nao1215)

Others

• 3745139: Merge remote-tracking branch 'origin/main' into fix/stable-comparison-design (@nao1215)

Full changelog: v0.2.0...v0.2.1

v0.2.0

himorime v0.2.0

Performance budgets and regression checks for command-line programs:
latency, throughput, CPU time and peak RSS. Every artifact is
signed and ships with an SBOM and build provenance; see
Verify a release.

Changelog

Features

• 84eb9a4: feat: accept a .. after ${root} or ${head_root} that stays in the project (@nao1215)
• 6e318e3: feat: measure a command on a terminal with terminal: true (@nao1215)
• 6fc23ca: feat: type terminal input one key at a time once the command is ready (@nao1215)

Bug fixes

• 0fe0dce: fix(cli): measure and judge a suite the base revision does not have (@nao1215)
• f5b86c2: fix(report): show the probability that decided the verdict as CONFIDENCE (@nao1215)
• 5c6714d: fix(runner): write progress counts of one in the singular (@nao1215)
• adef98e: fix: count a key as read only after it reached the input queue (@nao1215)
• 8a11c5d: fix: decide the geometric mean note by shared commands, not the first benchmark (@nao1215)
• 130402a: fix: name a missing working directory instead of the program (@nao1215)
• 2f3216c: fix: remove a workdir that holds read-only directories (@nao1215)

Documentation

• 8432df7: docs(configuration): say what happens to a suite the base revision does not have (@nao1215)
• 3197533: docs: say that a suite new in this revision is measured and judged (@nao1215)
• 9966491: docs: show the whole report of the first run in getting started (@nao1215)

Others

• 848669e: Merge origin/main into fix/geometric-mean-note-order (@nao1215)

Full changelog: v0.1.3...v0.2.0

v0.1.3

himorime v0.1.3

Performance budgets and regression checks for command-line programs:
latency, throughput, CPU time and peak RSS. Every artifact is
signed and ships with an SBOM and build provenance; see
Verify a release.

Changelog

Features

• 1c9adf8: feat(bench): measure jq, gojq and jaq as a worked third-party suite (@nao1215)
• 7e0cc80: feat(report): record the robust coefficient of variation (@nao1215)

Bug fixes

• 4a704be: fix(config): reject a relative path that leaves the project when the suite is loaded (@nao1215)
• 9f72765: fix(config): stop a rejected work unit from shaping the errors after it (@nao1215)
• 65c6d2a: fix(examples): give the gate-cpu-memory recipe metrics it can compare (@nao1215)
• ffcd3eb: fix(proc): give the Linux peak RSS floor 1MiB of slack (@nao1215)
• dca00ad: fix(report): do not judge throughput measured over different work (@nao1215)
• 8418701: fix(stats): measure noise the way the compared statistic reacts to it (@nao1215)

Documentation

• 762f875: docs: name the character himorime comes from correctly (@nao1215)
• d753f67: docs: record the measured work, the new path rule and the two error messages (@nao1215)
• e6eba82: docs: say what max_cv is compared with, and document robust_cv (@nao1215)
• b92695e: docs: state the CPU time resolution of each platform (@nao1215)
• c425c17: docs: write each English paragraph on one line (@nao1215)

Full changelog: v0.1.2...v0.1.3