Skip to content

site: warm-install bench updated to Linux CI numbers (large fixture)#377

Merged
colinhacks merged 1 commit into
mainfrom
linux-install-bench
Jul 8, 2026
Merged

site: warm-install bench updated to Linux CI numbers (large fixture)#377
colinhacks merged 1 commit into
mainfrom
linux-install-bench

Conversation

@colinhacks

Copy link
Copy Markdown
Contributor

Updates the warm-install bench on the homepage, the introducing-nub post, and the install docs to the ubuntu-latest CI run on the large fixture (1168 packages, 81398 files): hyperfine, 25 runs / 6 warmup, warm store, frozen lockfile, node_modules wiped between runs. bun 1.3.14, pnpm 10.34.4, npm on Node 24.

Adds a nub --node-linker hoisted row (bun's flat layout, same per-file hardlink syscall) alongside the default symlink-per-package relink; each bench now labels platform + methodology. Removes the prior macOS numbers, which did not reproduce. Rendered output verified in-browser.

https://claude.ai/code/session_01UVBNLm9SkJGM8P8K6jnKLJ

…5 runs)

Replaces the macOS TanStack Start warm-install numbers on the homepage,
the introducing-nub blog post, and the install docs with the ubuntu-latest
CI run on the large fixture (1168 packages, 81398 files): hyperfine,
25 runs / 6 warmup, warm store, frozen lockfile, node_modules wiped
between runs. Adds a nub --node-linker hoisted row (same flat layout and
per-file hardlink syscall as bun) alongside the default symlink-per-package
relink, and labels platform + methodology on each bench component.

Claude-Session: https://claude.ai/code/session_01UVBNLm9SkJGM8P8K6jnKLJ
Copilot AI review requested due to automatic review settings July 8, 2026 14:10
@vercel

vercel Bot commented Jul 8, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
nub Ready Ready Preview, Comment Jul 8, 2026 2:12pm

Request Review

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

@colinhacks colinhacks merged commit a203fbf into main Jul 8, 2026
18 checks passed

@pullfrog pullfrog Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ℹ️ No critical issues — one stale-bench sweep worth a look.

Reviewed changes — updates the warm-install benchmark on three surfaces (homepage, introducing-nub post, install docs) from the retired macOS TanStack-Start numbers to a Linux ubuntu-latest CI run on the large fixture, plus copy explaining the two nub rows.

  • New Linux large numbers — nub 346 / nub hoisted 1461 (4.2×) / bun 1896 (5.5×) / pnpm 3453 (10×) / npm 12945 (37.4×), max=12945; applied identically across all three files.
  • --node-linker hoisted row added — bun's flat per-file-hardlink layout as the apples-to-apples bar; default row is the per-package symlink relink. Ratio math and max verified consistent in every file.
  • Caption/methodology copy — both <Bench> MDX benches gain a caption prop (supported by the component); the homepage BenchBars panel swaps its standalone "View methodology" link for an inline methodology caption.

ℹ️ Retired macOS numbers still live in the GVS blog post

The PR body states the prior macOS numbers "did not reproduce" and sweeps them from three surfaces, but a fourth surface still carries the exact same retired figures. site/content/blog/unblocking-the-global-virtual-store.mdx (around lines 218-229) renders a <Bench> with nub 171 / bun 686 / pnpm 3193 / npm 5316 and max={5316}, and the surrounding prose claims "warm installs are up to 4x faster" — the same non-reproducing macOS run this PR is replacing elsewhere.

This may be an intentional deferral (a dated blog post is a point-in-time artifact), so it's a scope call rather than a blocker.

Technical details
# Retired macOS bench numbers remain in the GVS blog post

## Affected sites
- `site/content/blog/unblocking-the-global-virtual-store.mdx:218-229``<Bench>` still shows the old macOS TanStack-Start numbers (`nub 171`, `bun 686`, `pnpm 3193`, `npm 5316`, `max={5316}`, `label="warm install · TanStack Start · macOS"`).
- `site/content/blog/unblocking-the-global-virtual-store.mdx:214` — prose "warm installs are up to 4x faster" is tied to those numbers.

## Required outcome
- Decide whether this post is in scope for the same sweep. If yes, update it to the Linux `large` numbers (or the thinner-tree TanStack figures this PR references) so no live surface shows the non-reproducing macOS run. If no, leave as-is deliberately.

## Open questions for the human
- Is a dated blog post treated as a point-in-time artifact (leave its numbers frozen) or as a living surface that must track the current bench? That answer decides whether this needs a follow-up.

Pullfrog  | Fix it ➔View workflow run | Using Claude Opus𝕏

colinhacks added a commit that referenced this pull request Jul 8, 2026
Brings the unblocking-the-global-virtual-store post in line with the
homepage and introducing-nub bench (merged in #377): ubuntu-latest run on
the large fixture (1168 packages, 81398 files), hyperfine 25 runs / 6
warmup, with the nub --node-linker hoisted row and platform + methodology
labels. Title and prose move from 4x to 5x, matching the new numbers.

Claude-Session: https://claude.ai/code/session_01UVBNLm9SkJGM8P8K6jnKLJ
@colinhacks

Copy link
Copy Markdown
Contributor Author

Shipped in v0.4.3: https://github.com/nubjs/nub/releases/tag/v0.4.3

@pullfrog pullfrog Bot mentioned this pull request Jul 8, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants