Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

control-service: Clean up old data job configurations #2075

Merged
merged 3 commits into from
May 29, 2023

Conversation

doks5
Copy link
Contributor

@doks5 doks5 commented May 16, 2023

As part of the initiative to support multiple python versions for data job deployments, we introduced new configurations through the datajobs.deployment.supportedPythonVersions and datajobs.deployment.defaultPythonVersion properties. This new configuration renders the old configurations through datajobs.vdk.image and datajobs.deployment.dataJobBaseImage essentially useless, as these are no longer used.

This change cleans up the old configurations and related code and tests, so that only the new configurations remain. A more descriptive list of the changes is as follows:

  • The DOCKER_VDK_BASE_IMAGE and DATAJOBS_DEPLOYMENT_DATAJOBBASEIMAGE environment variables are removed, as they are not needed anymore.
  • The templates associated with the above-mentioned env vars, projects/control-service/projects/helm_charts/pipelines-control-service/templates/_helpers.tpl, is also removed.
  • The JobImageDeployer, projects/control-service/projects/pipelines_control_service/src/main/java/com/vmware/taurus/service/deploy/JobImageDeployer.java, logic related to the stand-alone vdk image configuration is also cleaned up to use only the supportedPythonVersions functionality. Tests associated with the cleaned up logic are also removed.

The new configurations were introduced in #2022 and #1935

Testing Done: CI/CD

@doks5 doks5 requested review from ivakoleva and murphp15 May 17, 2023 07:54
@doks5 doks5 force-pushed the person/andonova/cleanup-old-configs branch from 70a3dc2 to f7c68d0 Compare May 17, 2023 14:15
@doks5 doks5 force-pushed the person/andonova/cleanup-old-configs branch from 6ec28eb to 87d26d5 Compare May 29, 2023 07:33
@doks5 doks5 linked an issue May 29, 2023 that may be closed by this pull request
doks5 and others added 3 commits May 29, 2023 15:30
As part of the initiative to support multiple python versions for data job
deployments, we introduced new configurations through the `datajobs.deployment.supportedPythonVersions`
and `datajobs.deployment.defaultPythonVersion` properties.
This new configuration renders the old configurations through `datajobs.vdk.image` and
`datajobs.deployment.dataJobBaseImage` essentially useless, as these are no longer used.

This change cleans up the old configurations and related code and tests, so that only
the new configurations remain.

Testing Done: CI/CD

Signed-off-by: Andon Andonov <andonova@vmware.com>
Signed-off-by: Andon Andonov <andonova@vmware.com>
@doks5 doks5 force-pushed the person/andonova/cleanup-old-configs branch from 87d26d5 to 7f5e906 Compare May 29, 2023 12:30
@doks5 doks5 merged commit cf0a0b8 into main May 29, 2023
8 checks passed
@doks5 doks5 deleted the person/andonova/cleanup-old-configs branch May 29, 2023 13:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
6 participants