Skip to content

Make TVM build parallel in conda environment on Windows#12475

Closed
kparzysz-quic wants to merge 1 commit intoapache:mainfrom
kparzysz-quic:parallel-build
Closed

Make TVM build parallel in conda environment on Windows#12475
kparzysz-quic wants to merge 1 commit intoapache:mainfrom
kparzysz-quic:parallel-build

Conversation

@kparzysz-quic
Copy link
Contributor

No description provided.

:: under the License.

cmake --build build --config Release --target install
cmake --build build --config Release --target install -- /p:CL_MPcount=8
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is it possible to use the windows equivalent of nproc here instead of always assuming it's 8?

Copy link
Contributor Author

@kparzysz-quic kparzysz-quic Aug 17, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think =0 will use all available processors. I didn't see a lot of improvement from =8 (plus googling suggests limiting this number), so I'll try 2 and 4 next.

@kparzysz-quic
Copy link
Contributor Author

There is really no difference in the Windows build time regardless of the value of this option. :(

Closing this PR.

@kparzysz-quic kparzysz-quic deleted the parallel-build branch August 17, 2022 21:45
@driazati
Copy link
Member

Just wondering is this for CI Windows builds? If so we could probably chase down #11550 to get some speedups

@kparzysz-quic
Copy link
Contributor Author

Yes. I thought it was an easy way to get some speedup, but it didn't work. Builds with 2, 4, and 8 took about the same amount of time (roughly 100 minutes). Also, many sources on the Internet suggested using a lower number, since multiple compilations could consume enough memory to cause extensive swapping.

The Windows build is not the longest in the CI, so I'm not sure if it's worth to spend a lot of effort trying to accelerate it. It attracted my attention because I had to fix build failures on Windows (related to the switch to C++17), and each round took quite a while to get to the point of failure. On the other hand, if you have time, don't let anything dissuade you from working on this. 🙂

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants