-
Notifications
You must be signed in to change notification settings - Fork 5.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Serve] add dependency management #11743
Conversation
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
…into override-worker-env
Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>
…into serve-dep-mgmt
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
@architkulkarni looks like some of the CI jobs failed mysteriously. Restarting, should be good to merge after that. |
python/ray/serve/api.py
Outdated
from ray.actor import ActorHandle | ||
from typing import Any, Callable, Dict, List, Optional, Type, Union | ||
import os |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
can you move the import to line 4? stdlib should be groupped together, see https://google.github.io/styleguide/pyguide.html#313-imports-formatting
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Sure thing, thanks for the reference!
python/ray/serve/tests/test_util.py
Outdated
@@ -1,12 +1,13 @@ | |||
import asyncio | |||
import json | |||
from copy import deepcopy | |||
|
|||
import os |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
move this import to first group stdlib
Co-authored-by: Simon Mo <simon.mo@hey.com>
Why are these changes needed?
Uses environment variable overrides for actors (#11619) to allow simultaneously serving backends with conflicting dependencies, using
conda
environments. The environments must be preinstalled on all nodes.Usage example:
Related issue number
Comments on an earlier version of this PR can be found at architkulkarni#1.
Checks
scripts/format.sh
to lint the changes in this PR.