Skip to content

Test: Bump hydrate bench to 1000 items#177

Merged
jlukic merged 1 commit intomainfrom
test/hydrate-bench-1000-items
May 2, 2026
Merged

Test: Bump hydrate bench to 1000 items#177
jlukic merged 1 commit intomainfrom
test/hydrate-bench-1000-items

Conversation

@jlukic
Copy link
Copy Markdown
Member

@jlukic jlukic commented May 2, 2026

The 100-item bench durations (~6-16ms) sit in the ±10-28% noise band per the perf-improvement skill's bench-duration table — too short to resolve small deltas. At 1000 items (~60-160ms) the bench falls into the ±1% band where per-item cost differences become measurable.

Metric names keep the -100 suffix; only the underlying N changed (one-line edit at two call sites).

Risk

2/10 — bench-only. Existing report comparisons will look discontinuous (1000-item numbers vs. prior 100-item baseline) but that's correct — the prior numbers were unresolvable.

The 100-item bench duration (~6-16ms) sits in the ±10-28% noise band
per the perf-improvement skill's bench-duration table. At 1000 items
(~60-160ms) the bench resolves into the ±1% band where small per-item
cost differences become measurable.

Metric names retain the '-100' suffix; only the underlying N changed.
@vercel
Copy link
Copy Markdown

vercel Bot commented May 2, 2026

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
semantic-next Building Building Preview, Comment May 2, 2026 10:15pm
1 Skipped Deployment
Project Deployment Actions Updated (UTC)
mcp Ignored Ignored May 2, 2026 10:15pm

Request Review

@jlukic jlukic merged commit eba1804 into main May 2, 2026
12 of 13 checks passed
@jlukic jlukic deleted the test/hydrate-bench-1000-items branch May 2, 2026 22:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant