Error when building a giant document repo (1.2K documents, 4K+ links)

[anaclumos]

It finishes with the following statement:

<--- Last few GCs --->

[14773:0x7faf90008000]   384213 ms: Scavenge 3933.4 (4107.6) -> 3932.9 (4115.6) MB, 5.6 / 0.0 ms  (average mu = 0.345, current mu = 0.427) allocation failure
[14773:0x7faf90008000]   384257 ms: Scavenge 3939.6 (4115.6) -> 3938.6 (4115.6) MB, 8.0 / 0.0 ms  (average mu = 0.345, current mu = 0.427) allocation failure
[14773:0x7faf90008000]   384282 ms: Scavenge 3940.6 (4115.6) -> 3939.6 (4131.6) MB, 12.6 / 0.0 ms  (average mu = 0.345, current mu = 0.427) allocation failure


<--- JS stacktrace --->

FATAL ERROR: Ineffective mark-compacts near heap limit Allocation failed - JavaScript heap out of memory
 1: 0x10d2d8ef5 node::Abort() (.cold.1) [/usr/local/bin/node]
 2: 0x10bfcc869 node::Abort() [/usr/local/bin/node]
 3: 0x10bfcc9df node::OnFatalError(char const*, char const*) [/usr/local/bin/node]
 4: 0x10c14ef07 v8::Utils::ReportOOMFailure(v8::internal::Isolate*, char const*, bool) [/usr/local/bin/node]
 5: 0x10c14eea3 v8::internal::V8::FatalProcessOutOfMemory(v8::internal::Isolate*, char const*, bool) [/usr/local/bin/node]
 6: 0x10c2f0585 v8::internal::Heap::FatalProcessOutOfMemory(char const*) [/usr/local/bin/node]
 7: 0x10c2f45cd v8::internal::Heap::RecomputeLimits(v8::internal::GarbageCollector) [/usr/local/bin/node]
 8: 0x10c2f0ead v8::internal::Heap::PerformGarbageCollection(v8::internal::GarbageCollector, v8::GCCallbackFlags) [/usr/local/bin/node]
 9: 0x10c2ee3cd v8::internal::Heap::CollectGarbage(v8::internal::AllocationSpace, v8::internal::GarbageCollectionReason, v8::GCCallbackFlags) [/usr/local/bin/node]
10: 0x10c2fb7b0 v8::internal::Heap::AllocateRawWithLightRetrySlowPath(int, v8::internal::AllocationType, v8::internal::AllocationOrigin, v8::internal::AllocationAlignment) [/usr/local/bin/node]
11: 0x10c2fb831 v8::internal::Heap::AllocateRawWithRetryOrFailSlowPath(int, v8::internal::AllocationType, v8::internal::AllocationOrigin, v8::internal::AllocationAlignment) [/usr/local/bin/node]
12: 0x10c2c281d v8::internal::FactoryBase<v8::internal::Factory>::NewRawOneByteString(int, v8::internal::AllocationType) [/usr/local/bin/node]
13: 0x10c2ca19c v8::internal::Factory::NewStringFromOneByte(v8::base::Vector<unsigned char const> const&, v8::internal::AllocationType) [/usr/local/bin/node]
14: 0x10c170d4f v8::String::NewFromOneByte(v8::Isolate*, unsigned char const*, v8::NewStringType, int) [/usr/local/bin/node]
15: 0x10bf0353f node::UVException(v8::Isolate*, int, char const*, char const*, char const*, char const*) [/usr/local/bin/node]
16: 0x10bfd18bd node::fs::FSReqAfterScope::Reject(uv_fs_s*) [/usr/local/bin/node]
17: 0x10bfd1a4b node::fs::AfterStat(uv_fs_s*) [/usr/local/bin/node]
18: 0x10c998598 uv__work_done [/usr/local/bin/node]
19: 0x10c99d75b uv__async_io [/usr/local/bin/node]
20: 0x10c9b154b uv__io_poll [/usr/local/bin/node]
21: 0x10c99dce1 uv_run [/usr/local/bin/node]
22: 0x10befdf9f node::SpinEventLoop(node::Environment*) [/usr/local/bin/node]
23: 0x10c00df01 node::NodeMainInstance::Run(int*, node::Environment*) [/usr/local/bin/node]
24: 0x10c00db59 node::NodeMainInstance::Run(node::EnvSerializeInfo const*) [/usr/local/bin/node]
25: 0x10bf9895b node::Start(int, char**) [/usr/local/bin/node]
26: 0x7ff816438310 start [/usr/lib/dyld]

[Abinashbunty]

You can perhaps refer to this Stackoverflow answer. 😄

[slorber]

Out-of-memory errors are usually solved by giving Docusaurus more Node.js memory through env NODE_OPTIONS=--max_old_space_size=4096 or something similar

Unfortunately, Docusaurus memory consumption is quite high currently, related to #4765