-
Notifications
You must be signed in to change notification settings - Fork 5.8k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[autoscaler] Fix worker capping fifo test in new scheduler #12512
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM. One comment.
Test still failing |
Still failing |
Still seems failing due to travis not starting 3 workers when num_cpus=3 somehow. I'm inclined to remove this test since it's inherently brittle, and should be unit tested instead (though not sure if we currently have such a unit test). @kfstorm does this sound ok? |
@ericl It sounds good to me. But can you add a test in |
@kfstorm I don't have the bandwidth to do that, we can also ignore the test for now and go ahead with the new scheduler regardless |
@ericl OK, I'll add the test into |
In the new scheduler, workers are popped more aggressively. This isn't incorrect, but breaks the test. Fix the test by changing the condition to be a bit more relaxed.
Closes #12435