Join GitHub today
GitHub is home to over 40 million developers working together to host and review code, manage projects, and build software together.Sign up
Support slowly arriving workers in SpecCluster #2904
Previously SpecCluster waited until all workers had checked in with the
Now, SpecCluster still awaits the Worker object that it is passed, but
"We have successfully handed control of starting the worker to some other robust system"
Our job at this point is done. We hope that the worker arrives, but
This commit also includes a minimal example of a Worker class,
I plan to do a bit more work here and review our Adaptive policies when workers
@jcrist would you mind reviewing the adaptive_core.py file? I think that it abstracts away all of the adaptive logic from assumptions about the cluster class. It would be both to get your perspective as a controls person, and also as someone who might want to connect this logic to another cluster class type (or two) in the future.