Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[serve] Add serve.get_deployment() API #14953

Merged
merged 14 commits into from
Mar 31, 2021

Conversation

edoakes
Copy link
Contributor

@edoakes edoakes commented Mar 26, 2021

Why are these changes needed?

Makes it easier to update deployments from a new script. For example, to scale replicas:

serve.get_deployment(name).options(num_replicas=10).deploy()

Related issue number

Closes #14955

Checks

  • I've run scripts/format.sh to lint the changes in this PR.
  • I've included any doc changes needed for https://docs.ray.io/en/master/.
  • I've made sure the tests are passing. Note that there might be a few flaky tests, see the recent failures at https://flakey-tests.ray.io/
  • Testing Strategy
    • Unit tests
    • Release tests
    • This PR is not tested :(

@edoakes edoakes changed the title [serve] Add serve.get_deployment() API [WIP] [serve] Add serve.get_deployment() API Mar 26, 2021
@edoakes edoakes changed the title [WIP] [serve] Add serve.get_deployment() API [serve] Add serve.get_deployment() API Mar 26, 2021
@edoakes
Copy link
Contributor Author

edoakes commented Mar 27, 2021

FYI this is rebased off of #14935

@edoakes
Copy link
Contributor Author

edoakes commented Mar 29, 2021

This is ready for review.

Copy link
Contributor

@architkulkarni architkulkarni left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good! Just had some minor comments and questions

python/ray/serve/api.py Outdated Show resolved Hide resolved
python/ray/serve/api.py Outdated Show resolved Hide resolved
python/ray/serve/backend_state.py Show resolved Hide resolved
python/ray/serve/api.py Outdated Show resolved Hide resolved
python/ray/serve/endpoint_state.py Show resolved Hide resolved
@edoakes
Copy link
Contributor Author

edoakes commented Mar 30, 2021

@architkulkarni your comments are addressed

@edoakes edoakes merged commit 4061b72 into ray-project:master Mar 31, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Make it easier to update options on running deployments from a different script
3 participants