You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When the cluster owner identity changes (e.g., user switches AWS account, changes GCP project or switches Kubernetes context) and the spot/serve controller is running in the previous identity, new sky serve up and sky spot launch would fail with sky.exceptions.ClusterOwnerIdentityMismatchError: 'sky-serve-controller-<hash>' (Kubernetes) is owned by account ['old_id'], but the activated account is ['new_id'].
In this case, we should launch a new controller under the new identity while letting the old one run.
Note that this would also need careful UX handling for sky status, sky serve status and sky spot queue to print out a clear message saying that a) multiple controllers are running and b) the identity of the services/jobs currently shown.
The text was updated successfully, but these errors were encountered:
A prototype for k8s is implemented here: b7c57b3. This overrides the controller name to be unique per-identity, and as a result multiple controllers can be launched.
Gotchas:
Service names must be unique across all identities (namespaces).
sky serve status will only show services in the current namespace specified in the kube context. To view service status from other namespaces, user must switch kubecontext and run sky serve status
When the cluster owner identity changes (e.g., user switches AWS account, changes GCP project or switches Kubernetes context) and the spot/serve controller is running in the previous identity, new
sky serve up
andsky spot launch
would fail withsky.exceptions.ClusterOwnerIdentityMismatchError: 'sky-serve-controller-<hash>' (Kubernetes) is owned by account ['old_id'], but the activated account is ['new_id']
.In this case, we should launch a new controller under the new identity while letting the old one run.
Note that this would also need careful UX handling for
sky status
,sky serve status
andsky spot queue
to print out a clear message saying that a) multiple controllers are running and b) the identity of the services/jobs currently shown.The text was updated successfully, but these errors were encountered: