Join GitHub today
GitHub is home to over 40 million developers working together to host and review code, manage projects, and build software together.Sign up
Use remote build execution to run several unit tests #8051
Per #7649, we have been working to run Pants unit tests via Google Remote Build Execution (RBE) for higher parallelism (and thus faster CI results).
This hooks up to the secure token generator created at https://github.com/pantsbuild/rbe-token-server, per the design doc at https://docs.google.com/document/d/1gL3D1f-AzL_LzRxWLskCpVQ2ZlB_26GTETgXkXsrpDY/edit#.
It introduces a new flag to
We must blacklist 5% of the targets, which will be addressed in followup PRs.
As a result, unit test CI goes from 40 minutes to 15 minutes.
Will close #7649.
3 times, most recently
Jul 16, 2019
changed the title
WIP: Use remote build execution to run several unit tests
Jul 16, 2019
stuhood left a comment •
As mentioned above: the blacklist for remoting probably needs to be a whitelist until the fundamental issues are figured out.
Depending on how long the fundamental issues might take to resolve, you could either invert from blacklist to whitelist here, or block this PR on fixing sdist building in the remote environment.
Ah, I see what you mean @hrfuller. This is very intentional. We want
I will try to fix the sdist issue (#8057) today, and if I can't figure it out by tonight will convert this to a whitelist to ensure that we can land this before Thursday.