Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[tune] Placement group manager fixes #16844

Merged
merged 7 commits into from
Jul 7, 2021

Conversation

Yard1
Copy link
Member

@Yard1 Yard1 commented Jul 2, 2021

Why are these changes needed?

This PR fixes two major issues with placement group manager, which were uncovered during implementation of a dynamic resource allocation scheduler.

The first issue was that unusable placement groups were not being destroyed after being returned from a trial. The second issue was caused by the reconciliation method not accounting for placement groups that are unexpected, but still staged or ready.

Related issue number

Checks

  • I've run scripts/format.sh to lint the changes in this PR.
  • I've included any doc changes needed for https://docs.ray.io/en/master/.
  • I've made sure the tests are passing. Note that there might be a few flaky tests, see the recent failures at https://flakey-tests.ray.io/
  • Testing Strategy
    • Unit tests
    • Release tests
    • This PR is not tested :(

Yard1 and others added 3 commits July 2, 2021 17:12
Co-authored-by: Kai Fricke <kai@anyscale.com>
Co-authored-by: Kai Fricke <kai@anyscale.com>
@Yard1 Yard1 requested a review from krfricke July 2, 2021 15:22
@krfricke krfricke self-assigned this Jul 6, 2021
@richardliaw
Copy link
Contributor

looks like tests are good.

@richardliaw richardliaw changed the title [tune]Placement group manager fixes [tune] Placement group manager fixes Jul 7, 2021
@richardliaw richardliaw merged commit 8f41a34 into ray-project:master Jul 7, 2021
@Yard1 Yard1 deleted the placement_group_manager_fixes branch July 7, 2021 17:57
jiaodong pushed a commit that referenced this pull request Jul 11, 2021
Co-authored-by: Kai Fricke <kai@anyscale.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants