Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

dispatch subgraphs of work to Bloop instead of every module #44

Closed
propensive opened this issue Nov 28, 2018 · 1 comment
Closed

dispatch subgraphs of work to Bloop instead of every module #44

propensive opened this issue Nov 28, 2018 · 1 comment
Assignees
Labels
backend Relates to the backend enhancement New feature or request
Projects

Comments

@propensive
Copy link
Owner

Fury manages all dependencies between modules, and dispatches independent compilation requests to Bloop, one for every module. Bloop has no awareness of the dependencies between modules.

But Bloop configuration files could be made aware of dependencies between library, plugin and compiler modules (but not application modules), and Fury could take advantage of faster pipelining in Bloop between these modules.

We need to work at the "subgraph" level because it's not possible to get Bloop to run an application in the middle of a build (only at the end), and we can't pipeline compilation across an application module anyway (because it has to complete compilation and run before the next module can start compiling). So Fury will need to compute subgraphs containing at most one application module.

This also requires using BSP to get progress information from Bloop, i.e. the details of when each module starts or finishes compiling.

@propensive propensive added enhancement New feature or request backend Relates to the backend labels Nov 28, 2018
@propensive propensive added this to the v0.2.0 milestone Nov 28, 2018
@propensive propensive self-assigned this Nov 28, 2018
@propensive propensive added this to ready in release via automation Nov 28, 2018
@propensive propensive modified the milestones: v0.2.0, future Dec 3, 2018
@propensive propensive assigned tpasternak and unassigned propensive Feb 21, 2019
@propensive
Copy link
Owner Author

@tpasternak Your next PR should fix this. :)

release automation moved this from scoped to done Oct 12, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backend Relates to the backend enhancement New feature or request
Projects
release
  
done
Development

No branches or pull requests

2 participants