aube has a really high peak memory footprint #1301
Replies: 4 comments
|
thanks for the report, nobody has mentioned this yet (at least that I can recall) |
|
I opened #1303 to make the existing diagnostics work through mise's embedded aube path and add memory-specific samples. Please wait until that PR lands and the change is included in a mise build before collecting anything—the current embedded path does not initialize these diagnostics. Once it is available, please reproduce with: AUBE_DIAG_FILE=/tmp/aube-memory.jsonl \
AUBE_DIAG_KERNEL=1 \
AUBE_DIAG_FLUSH=1 \
/usr/bin/time -v mise install npm:opencode-ai \
2>/tmp/aube-memory.txtYou can either send me
The trace may contain package names and local paths, so please inspect/redact it before sharing raw data if needed. AI-assisted — Tool: Codex; model: OpenAI/GPT-5; version: unavailable. |
|
Thanks, this was enough to reproduce it locally. The main resolver spike is not random: with the default release-age/trust checks enabled, every exact optional platform package was loading its entire version history before aube wrote all platform variants to the lockfile. For I opened #1315. It keeps the cross-platform lockfile and trust checks intact, but retains only the selected version's complete metadata plus compact publish-time/trust history for these optional dependencies. I also ran a four-way production-build comparison. These are medians of three cold, isolated
The first version of the mitigation cut memory but made a separate exact-version request for every platform package; its median was 4.73s, which was not a tradeoff I wanted to merge. I reworked it to selectively decode the exact version and compact trust history from a single full-packument response. That removes the 12 extra requests and brings the median to 3.80s, versus 4.03s on Cold-network variance makes the small elapsed-time difference inconclusive, but there is no observed wall-time regression now. The patched build uses 53% less memory than pnpm 11 and 35% less than pnpm 12 RC in this reproduction. pnpm 12 is still an RC; no stable pnpm 12 release is published yet. I also found and removed one deterministic wall-time cost while profiling the remainder: aube eagerly installed its cached All four lockfiles contain all 13 platform variants and only materialize the three Linux/x64-applicable packages. The remaining aube peak is now clearly later: the two matching Linux packages each contain a 184 MB binary and are extracted concurrently. So this PR fixes the resolver amplification; it does not pretend those two large host binaries are free. The duplicate/progress-bar mess shown in the recording was fixed on the mise side in 2026.7.14 and later. If you still see it on a current mise release, let me know. Please wait for #1315 to land and make it into mise, then retry. If memory is still unexpectedly high, you can either send me the raw diagnostic data, or have your agent summarize the results for me. The most useful summary is peak RSS and phase, AI-assisted — Tool: Codex; model: OpenAI/GPT-5; version: unavailable. |

Uh oh!
There was an error while loading. Please reload this page.
it takes more than 1.5G memory to mise install npm:opencode-ai and causes high memory pressure on my multiple cloud hosts. i have to forcibly reboot my machine and add more swap to prevent it from oom again.
All reactions