Skip to content

Reduce default worker count to 2x logical CPU core count#363

Merged
augustjk merged 3 commits intomainfrom
reduce-default-worker-count
Jul 26, 2022
Merged

Reduce default worker count to 2x logical CPU core count#363
augustjk merged 3 commits intomainfrom
reduce-default-worker-count

Conversation

@augustjk
Copy link
Copy Markdown
Collaborator

Doing 4 * os.cpus().length seems a little too taxing on the system. When many tests are run in parallel, a test can take significantly longer causing it to hit timeouts that it otherwise would not have hit when run standalone, requiring increasing the timeout as seen here lit/lit#3182. Reducing to 2x seems more reasonable.

Also updated the docs to say the default is a multiple of "logical CPU cores", which is the count of the number threads the OS sees the system can process, instead of just "CPUs" or "CPU cores", in line with Node's doc on what os.cpus() returns.

@augustjk augustjk requested a review from aomarks July 26, 2022 21:59
Copy link
Copy Markdown
Member

@aomarks aomarks left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I agree being a little more conservative is a good idea given our experience with Lit monorepo CI.

@augustjk augustjk enabled auto-merge (squash) July 26, 2022 22:06
@augustjk augustjk merged commit 652257b into main Jul 26, 2022
@augustjk augustjk deleted the reduce-default-worker-count branch July 26, 2022 22:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants