Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(kubernetes): Skip loading events for manifest retrieval in WaitF… #2997

Merged
merged 3 commits into from
Jun 20, 2019

Conversation

mtweten
Copy link
Contributor

@mtweten mtweten commented Jun 19, 2019

This change makes use of the changes in spinnaker/clouddriver#3796 to skip loading events when retrieving manifests in WaitForManifestStableTask.

We ran into this scenario when we had a lot of deployment pipelines running concurrently, and each deployment involved a decent number of manifests (~30). This task iterates through the manifests involved in the deployment and calls the retrieve manifest API for each one, which (when live manifest mode is enabled) causes a lot of full event loads to occur, which tanks (in our case) the kubernetes API server.

WaitForManifestStableTask does not actually need any event information to do its job, so in this particular case we can skip loading events and prevent the extra load on the kubernetes api server.

Copy link
Contributor

@ezimanyi ezimanyi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'll take a closer look after any changes to support the changes in spinnaker/clouddriver#3796 are made here.

I think a similar change here would make sense, where we just always require calls to getManifest to pass in includeEvents. I think that actually from orca we'll never need events as the only other call is from FindArtifactsFromResource and that also immediately discards any events on the returned object so all calls can probably just pass false there.

@mtweten
Copy link
Contributor Author

mtweten commented Jun 20, 2019

Alright, addressed review comments and the corresponding clouddriver PR has also been updated.

Copy link
Contributor

@ezimanyi ezimanyi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, thanks!

@ezimanyi ezimanyi merged commit 39c4dbe into spinnaker:master Jun 20, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants