Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

vdk-quickstart: remove use of global varaibles in CI #1726

Merged
merged 2 commits into from
Mar 9, 2023

Conversation

antoniivanov
Copy link
Collaborator

@antoniivanov antoniivanov commented Mar 9, 2023

The use of global variables in GitLab CI can create problems when multiple CI files are being imported, as variables are not scoped to a specific file. This can lead to unexpected variables being set, causing issues in the CI/CD pipeline.

This is what is happening wiht quickstart-vdk test - https://gitlab.com/vmware-analytics/versatile-data-kit/-/jobs/3901914540

It expected that there's python installed because it's supposed to use python image but some other file overrides this image to docker and causes the test to fail.

This changes quickstart-vdk to use job-level variables.

In future changes I will be changing all CIs to use job-level variables or environment variables to avoid conflicts and ensure proper scoping. Or ensure that global variabels and labels are prefixed with the project or plugin name.

This is part of #1559

Testing Done: this PR CI

The use of global variables in GitLab CI can create problems when
multiple CI files are being imported, as variables are not scoped to a
specific file. This can lead to unexpected variables being set, causing
issues in the CI/CD pipeline.

This is what is happening wiht quickstart-vdk test -
https://gitlab.com/vmware-analytics/versatile-data-kit/-/jobs/3901914540

It expected that there's python installed because it's supposed to use
python image but some other file overrides this image to docker and
causes the test to fail.

This changes quickstart-vdk to use job-level variables.

In future changes I will be changing all CIs to use  job-level variables
or environment variables to avoid conflicts and ensure proper scoping.
Or ensure that global variabels and labels are prefixed with the project
or plugin name.

Testing Done: this PR CI

Signed-off-by: Antoni Ivanov <aivanov@vmware.com>
@antoniivanov antoniivanov force-pushed the person/aivanov/vdk-quickstart branch from ef5a2a0 to a07c767 Compare March 9, 2023 10:12
Copy link
Contributor

@yonitoo yonitoo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@antoniivanov antoniivanov enabled auto-merge (squash) March 9, 2023 12:51
@antoniivanov antoniivanov merged commit e41929a into main Mar 9, 2023
@antoniivanov antoniivanov deleted the person/aivanov/vdk-quickstart branch March 9, 2023 12:57
ivakoleva pushed a commit that referenced this pull request Mar 9, 2023
The use of global variables in GitLab CI can create problems when
multiple CI files are being imported, as variables are not scoped to a
specific file. This can lead to unexpected variables being set, causing
issues in the CI/CD pipeline.

This is what is happening wiht quickstart-vdk test -
https://gitlab.com/vmware-analytics/versatile-data-kit/-/jobs/3901914540

It expected that there's python installed because it's supposed to use
python image but some other file overrides this image to docker and
causes the test to fail.

This changes quickstart-vdk to use job-level variables.

In future changes I will be changing all CIs to use job-level variables
or environment variables to avoid conflicts and ensure proper scoping.
Or ensure that global variabels and labels are prefixed with the project
or plugin name.

This is part of #1559

Testing Done: this PR CI

Signed-off-by: Antoni Ivanov <aivanov@vmware.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants