fix: bounded parallelization when saving cache

[glesperance]

Fix for #711 (discussion #709).

Bounded cache saving parallelization to runtime.NumCPU() which now gives us the maximum number of effective threads while staying under the OS limit of max processes count.

Cheers 🎉

[vercel]

This pull request is being automatically deployed with Vercel (learn more).
To see the status of your deployment, click below or on the icon next to each commit.

🔍 Inspect: https://vercel.com/vercel/turbo-site/6KYpyJf7wDUM1jM4BhPZqvXyByAh
✅ Preview: https://turbo-site-git-fork-glesperance-fix-runtime-too-many-threads.vercel.sh

[Deployment for 3a4379d failed]

[gsoltis]

This looks like a much better approach!

I think the next step is to figure out how to thread a configuration value through to this point so that it can be customized.

[glesperance]

@gsoltis any chance we can get this merged without the configurable option? I understand a parameter would be good, but I feel it's best we fix the issue first.

[jaredpalmer]

Cutting now