perf: first ubuntu-latest baseline#24
Merged
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Commits the first
perf/baselines/ubuntu-latest.json, enabling the CI regression gate (median > baseline * 1.20) that has so far been warn-passing for lack of a baseline. Also updatesperf/baselines/README.mdto record capture provenance in place of the "no baseline committed yet" note.Capture provenance
98e06386afcf0ec02df8ba13208bdf9444050bf3full, budget scale 1.5,perfprofile,fixture_format_version1check_against_headindex_cold_150kindex_cold_2kindex_incremental_1map_cachedscore_3_changedsql_v1_queryAll seven scenarios are included, deliberately:
index_cold_2khas no absolute budget (informational) but still benefits from regression tracking.score_3_changedcurrently exceeds its absolute budget (2000 ms, 3000 ms at scale 1.5) — tracked in perf: ctx score --against HEAD is 3x over its hook-path budget on the 2k-file fixture #23. The baseline is the regression reference and is independent of the budget gate; the perf job stays advisory until perf: ctx score --against HEAD is 3x over its hook-path budget on the 2k-file fixture #23 is fixed.Verification
perf/src/compare.rs(Baseline { meta { profile, fixture_format_version, budget_scale_at_capture, commit }, scenarios }); shape asserted with a one-off script.cargo test --manifest-path perf/Cargo.toml— 20 tests pass.🤖 Generated with Claude Code