Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

control-service: a clear error message on how to handle the failed pipeline #2127

Merged
merged 6 commits into from
May 25, 2023

Conversation

murphp15
Copy link
Collaborator

@murphp15 murphp15 commented May 25, 2023

Why

Often we get in a situation where the helm chart can't be deployed because the previous deployment is in a pending state.
There is not a clear way of how to handle this. However we need to tell ppl how to investigate it.
for the last week all deployments failed because there was a deployment in pending state for 1 week.

What

exit the deployment early if there is a deployment in pending-state and include in stdout help on how to debug it.

How was this tested

I pushed the system into an unstable state and the error message printed out:https://gitlab.com/vmware-analytics/versatile-data-kit/-/jobs/4348854403
I also tested when the system is in a stable state and it all looks good

Signed-off-by: murphp15 <murphp15@tcd.ie>
@murphp15 murphp15 marked this pull request as draft May 25, 2023 07:32
Signed-off-by: murphp15 <murphp15@tcd.ie>
Signed-off-by: murphp15 <murphp15@tcd.ie>
Signed-off-by: murphp15 <murphp15@tcd.ie>
Signed-off-by: murphp15 <murphp15@tcd.ie>
Signed-off-by: murphp15 <murphp15@tcd.ie>
@murphp15 murphp15 changed the title [DRAFT] control-service: fix failing tests control-service: a clear error message on how to handle the failed pipeline May 25, 2023
@murphp15 murphp15 marked this pull request as ready for review May 25, 2023 08:50
@mivanov1988
Copy link
Contributor

Good improvement!

Copy link
Collaborator

@antoniivanov antoniivanov left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

I am more interested in why is it happening that often?

@murphp15 murphp15 merged commit 1beb172 into main May 25, 2023
12 of 13 checks passed
@murphp15 murphp15 deleted the person/murphp15/deploy_helm branch May 25, 2023 12:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants