How much memory is needed to compile?

[rococode]

I'm getting a

virtual memory exhausted: Cannot allocate memory

error when I try to compile (on the make -j step).

I'm running this on an AWS EC2 g4dn.xlarge machine which has 16GB RAM. Do I need more than that just to compile? When I run the make I indeed see free show memory usage steadily going up until the error appears and the build crashes.

[emjotde]

Hi,
with make -j you run many build processes, they quickly add up. Try make -j 8 or whatever works.

[hieuhoang]

We should changed the docs should to -j 4.

[emjotde]

I think this is oddly specific to AWS machines. I noticed make gets the number of CPUs/threads wrong there (because they are VMs?) and dispatches a much larger amount of processes than available threads.

[hieuhoang]

Without the number, make will run in parallel without limit which is always a bad idea. Best not encourage people to do that

…

On Sat, Jan 18, 2020, 11:05 PM Marcin Junczys-Dowmunt < ***@***.***> wrote: I think this is oddly specific to AWS machines. I noticed make gets the number of CPUs/threads wrong there (because they are VMs?) and dispatches a much larger amount of processes than available threads. — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#311?email_source=notifications&email_token=AAFI4FEHU4FL4Q4QQ5P6AY3Q6P3VBA5CNFSM4KIXQAUKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEJKKV5Y#issuecomment-575974135>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAFI4FHSF4HAGE3NN62IZ63Q6P3VBANCNFSM4KIXQAUA> .

[emjotde]

At least a comment about the potential memory issue is a good idea. Usually people compile on larger machines if they have GPUs, though.

[rococode]

Thank you for the very quick responses! make -j 8 worked successfully for me.