Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to temporarily stop serving? #4262

Closed
josephlewis42 opened this issue Jun 5, 2019 · 4 comments
Closed

How to temporarily stop serving? #4262

josephlewis42 opened this issue Jun 5, 2019 · 4 comments
Labels

Comments

@josephlewis42
Copy link

josephlewis42 commented Jun 5, 2019

In what area(s)?

/area autoscale
/area networking

Ask your question here:

What's the process to temporarily stop a serving.Service from scaling at all without deleting it and removing all of its history?

An example: let's say there's a mistake in your cluster where kservice A is handling user traffic and is causing an amplification issue to kservice B which is wrecking your databases. We'd like to be able to temporarily stop B (scale it to 0 and keep it there until we give it the go-ahead).

@markusthoemmes
Copy link
Contributor

markusthoemmes commented Jun 5, 2019

The way to do it would be via a traffic split. You'd assign 0% traffic to the revision that wrecks things.

@josephlewis42
Copy link
Author

Awesome, thanks @markusthoemmes. One more follow-up if I may, will that also work if there's only one revision? Otherwise I guess we could push a dummy service as the first one that we can always fall back to in the event of an issue.

I'm hoping the percentages are true percentages rather than what I think Istio VirtualServices do which is proportion of the total values defined.

@vagababov
Copy link
Contributor

vagababov commented Jun 5, 2019 via email

@mattmoor
Copy link
Member

To stop autoscaling you can patch the PodAutoscaler resource with minScale/maxScale annotations with the same value, which can also be lower than the current scale of the K8s deployment.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

5 participants