Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Consider how to expose parallelism #195

Open
brson opened this Issue Jul 13, 2017 · 3 comments

Comments

Projects
None yet
3 participants
@brson
Copy link
Contributor

brson commented Jul 13, 2017

From @briansmith:

Note that gcc-rs has a way of doing parallel building, but we were not able to use it efficiently because we had other build steps that we also wanted to run in parallel, and gcc-rs's parallel build support doesn't compose well with additional build parallelism implemented in the build.rs. It would be good to factor parallel build support and dependency tracking out into a more general (not just asm/C/C++) library.

This seems like an important consideration (I didn't even realize there was an optional rayon feature). What should we do here?

At the least we could add a num_jobs knob so the user can deal with it themselves. This issue of coordinating build system parallelism though is quite cross-cutting. Whatever the ultimate solution here is seems like it will entail interaction between make, cargo, this crate, the cmake crate, etc.

Needs more design work before we take action.

@brson

This comment has been minimized.

Copy link
Contributor Author

brson commented Jul 13, 2017

@sfackler

This comment has been minimized.

Copy link
Contributor

sfackler commented Jul 18, 2017

The new jobserver stuff in Cargo might help here right?

@alexcrichton

This comment has been minimized.

Copy link
Owner

alexcrichton commented Jul 19, 2017

Perhaps yeah, it'd want to integrate with that, but it wouldn't necessarily be an automatic interface to expose. Sort of what needs to be returned here is futures almost?

alexcrichton added a commit that referenced this issue Oct 19, 2017

Merge pull request #260 from rrichardson/parallel_docs
Docs for parallelism - Addresses #195 and #196
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
You can’t perform that action at this time.