Skip to content

chore(release): add 0.17.2 benchmark snapshot#565

Merged
benvinegar merged 1 commit into
chore/release-0.17.2from
chore/release-0.17.2-benchmark
Jul 18, 2026
Merged

chore(release): add 0.17.2 benchmark snapshot#565
benvinegar merged 1 commit into
chore/release-0.17.2from
chore/release-0.17.2-benchmark

Conversation

@benvinegar

Copy link
Copy Markdown
Member

Summary

  • Add the committed 0.17.2 release benchmark snapshot required by the tag-triggered publish workflow.
  • Confirm the release benchmark gate passes against 0.17.1 with no accepted or unaccepted material regressions.
  • Record stable performance for the narrow copy-selection and CLI-validation backports: first-frame latency improved 10%, non-ASCII first-frame latency improved 2%, and median hunk navigation stayed effectively flat.

This PR is stacked on #564 and should be retargeted to 0.17.x after the release-prep PR merges.

Verification

  • bun run bench:release (5 samples, Bun 1.3.14, Linux x64)
  • bun run bench:release:compare -- --version 0.17.2 --out /tmp/hunk-0.17.2-benchmark-comparison.json
  • bunx oxfmt --check benchmarks/release/bench-0.17.2.json
  • git diff --check

This PR description was generated by Pi using OpenAI GPT-5.2

@greptile-apps

greptile-apps Bot commented Jul 18, 2026

Copy link
Copy Markdown
Contributor

Greptile Summary

This PR adds the committed benchmark snapshot required to unlock the tag-triggered publish workflow for 0.17.2. It is a single generated JSON file with no logic changes.

  • bench-0.17.2.json records 5-sample runs on Bun 1.3.14/Linux x64 at the 9a5e1bcf release commit; gitSha, packageVersion, and runtime fields are all consistent with the expected release state.
  • Verified performance claims: interaction-latency/first_frame_ms median improved from 21.03 ms → 18.86 ms (~10.3%), non_ascii_cold_first_frame_ms median improved from 33.74 ms → 33.15 ms (~1.75%), and hunk_nav_press_median_ms stayed effectively flat (70.15 ms → 69.88 ms); all computed percentile values match the raw samples using the repository's max-as-p95 convention.
  • The single notable outlier is one hunk_nav_press_p95_ms sample of 160.54 ms (max across five runs), up from 131.54 ms in 0.17.1, but the median for that metric actually improved (87.7 ms vs 90.81 ms), so no threshold breach is triggered.

Confidence Score: 5/5

Safe to merge — this is a single generated benchmark snapshot with no logic changes.

The only file changed is a machine-generated JSON snapshot. The internal statistics are self-consistent (medians, percentiles, and sample arrays agree), the gitSha and packageVersion fields correctly identify the release commit, and the performance delta versus 0.17.1 aligns with the numbers stated in the description. No threshold breaches are present in the comparable metrics.

No files require special attention.

Important Files Changed

Filename Overview
benchmarks/release/bench-0.17.2.json New benchmark snapshot for 0.17.2 release; structure and computed statistics are consistent with prior snapshots, and performance claims in the PR description are numerically accurate.

Sequence Diagram

%%{init: {'theme': 'neutral'}}%%
sequenceDiagram
    participant Dev as Developer
    participant CI as bun run bench:release
    participant Repo as Release Commit (9a5e1bc)
    participant Gate as bench:release:compare
    participant PR as This PR

    Dev->>Repo: checkout chore/release-0.17.2
    Dev->>CI: run 5 samples against release commit
    CI->>Repo: execute benchmarks (Bun 1.3.14 / Linux x64)
    CI-->>Dev: bench-0.17.2.json (gitSha, packageVersion, results)
    Dev->>Gate: compare 0.17.2 vs 0.17.1 baseline
    Gate-->>Dev: no material regressions (first_frame -10%, non_ascii -2%, hunk_nav flat)
    Dev->>PR: commit bench-0.17.2.json
    PR-->>CI: tag-triggered publish workflow unblocked
Loading
%%{init: {'theme': 'base', 'themeVariables': {"darkMode": true, "background": "#0d1117", "primaryColor": "#21262d", "primaryTextColor": "#e6edf3", "primaryBorderColor": "#8b949e", "lineColor": "#8b949e", "textColor": "#e6edf3", "edgeLabelBackground": "#161b22", "actorBkg": "#21262d", "actorBorder": "#8b949e", "actorTextColor": "#e6edf3", "actorLineColor": "#8b949e", "signalColor": "#8b949e", "signalTextColor": "#e6edf3", "noteBkgColor": "#373320", "noteBorderColor": "#d4a72c", "noteTextColor": "#f0e6c0", "labelBoxBkgColor": "#21262d", "labelBoxBorderColor": "#8b949e", "labelTextColor": "#e6edf3", "loopTextColor": "#e6edf3", "activationBkgColor": "#30363d", "activationBorderColor": "#8b949e"}}}%%
sequenceDiagram
    participant Dev as Developer
    participant CI as bun run bench:release
    participant Repo as Release Commit (9a5e1bc)
    participant Gate as bench:release:compare
    participant PR as This PR

    Dev->>Repo: checkout chore/release-0.17.2
    Dev->>CI: run 5 samples against release commit
    CI->>Repo: execute benchmarks (Bun 1.3.14 / Linux x64)
    CI-->>Dev: bench-0.17.2.json (gitSha, packageVersion, results)
    Dev->>Gate: compare 0.17.2 vs 0.17.1 baseline
    Gate-->>Dev: no material regressions (first_frame -10%, non_ascii -2%, hunk_nav flat)
    Dev->>PR: commit bench-0.17.2.json
    PR-->>CI: tag-triggered publish workflow unblocked
Loading

Reviews (1): Last reviewed commit: "chore(release): add 0.17.2 benchmark sna..." | Re-trigger Greptile

@benvinegar
benvinegar merged commit e68eff7 into chore/release-0.17.2 Jul 18, 2026
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant