fix(ci): improve Docker image caching and native build skip optimization#92633
Merged
fix(ci): improve Docker image caching and native build skip optimization#92633
Conversation
Contributor
Author
This stack of pull requests is managed by Graphite. Learn more about stacking. |
Collaborator
Failing test suitesCommit: c22d352 | About building and testing Next.js
Expand output● instant-nav-panel › should show loading skeleton during SPA navigation after clicking Start |
![vercel[bot]](https://avatars.githubusercontent.com/in/8329?s=60&v=4){kind=small}
Collaborator
Stats from current PR✅ No significant changes detected📊 All Metrics📖 Metrics GlossaryDev Server Metrics:
Build Metrics:
Change Thresholds:
⚡ Dev Server
📦 Dev Server (Webpack) (Legacy)📦 Dev Server (Webpack)
⚡ Production Builds
📦 Production Builds (Webpack) (Legacy)📦 Production Builds (Webpack)
📦 Bundle SizesBundle Sizes⚡ TurbopackClient Main Bundles
Server Middleware
Build DetailsBuild Manifests
📦 WebpackClient Main Bundles
Polyfills
Pages
Server Edge SSR
Middleware
Build DetailsBuild Manifests
Build Cache
🔄 Shared (bundler-independent)Runtimes
📎 Tarball URL |
mmastrac
force-pushed
the
mmastrac/docker-cache-improvements
branch
from
95aa7f1 to
94cdf02
Compare
bgw
approved these changes
Apr 10, 2026
Comment on lines
+125
to
+127
| sh( | ||
| `zstd -d -c --long=27 --threads=0 ${zstFile} | docker import ${changeFlags} - ${IMAGE_NAME}` | ||
| ) |
Member
There was a problem hiding this comment.
Does it make sense to retry the decompression and import? Is the idea that sometimes the download can be corrupted?
Contributor
Author
There was a problem hiding this comment.
We're using http:// here and the files are large enough that I managed to get at least one mangled download. 😢
Contributor
Author
There was a problem hiding this comment.
Our local build cache doesn't leave the intranet apparently so this is ok but we lose integrity checks.
mmastrac
force-pushed
the
mmastrac/docker-cache-improvements
branch
from
94cdf02 to
f0e53bd
Compare
- turbo-cache.mjs: Add 16MB highWaterMark (was 16KB default) for stream
downloads/uploads. Add transfer stats tracking (totalBytes, speed,
maxStallMs) with 5s stall warning. Add formatStats() helper. Change
getToFile() to return { ok, stats } instead of boolean.
- docker-image-cache.js: Switch from docker save/load to export/import
(flat filesystem, no redundant base layers). Use zstd --long=27 for
better compression of large similar blocks. Add retries (3 attempts).
Add arch-aware cache key. Remove unused pipeToShell/spawn. Add
download stats logging.
- native-cache.js: Use new getToFile() return shape, log download stats.
- build_and_deploy.yml: Reorder steps to try native binary cache restore
BEFORE loading the Docker image. If the binary cache hits, skip the
expensive Docker image restore entirely.
mmastrac
force-pushed
the
mmastrac/docker-cache-improvements
branch
from
f0e53bd to
c22d352
Compare
mmastrac
force-pushed
the
mmastrac/docker-cache-improvements
branch
2 times, most recently
from
2ed35d2 to
c22d352
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
4 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
getToFile()now returns{ ok, stats }.docker save/loadtoexport/import(drops redundant base image layers). Usezstd --long=27for better compression. Add 3x retry logic. Add arch-aware cache key to prevent cross-arch cache poisoning. Add download stats logging.getToFile()return shape, log download stats.