-
Notifications
You must be signed in to change notification settings - Fork 3.7k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Configurable worker pull image policy in k8s #6827
Configurable worker pull image policy in k8s #6827
Conversation
…nfigurable-worker-pull-image-policy
thanks @mmolimar! @davinchia / @jrhizor can you review this contribution? |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good.
One minor thing, we are going to change our terminology here in the future to avoid confusion.
We actually have worker pods and job pods, both are separate from each other and do separate things. This separation is recent which explains the mixed terms we currently have.
The image pull policy you've added is actually for job pods. Can you change the name from worker to jobs? I can take care of cleaning up the rest in a follow up PR. Thanks.
Done! @davinchia |
@mmolimar oops I should be clearer, the change is from Sorry for the back and forth! Thanks :) |
Just that change? or maybe also the env var @davinchia ? |
@mmolimar the env var should be renamed to match it too, thanks! |
Done! @davinchia |
What
Adds a new property to allow configuring the worker image pull policy when deploying Airbyte on Kubernetes.
How
Added a new environment variable in the
EnvConfigs
class to be used in theKubePodProcess
class to set the image pull policy.Also, in the
WorkerUtils
I've added theCONFIGS
object as a static one.Recommended reading order
KubePodProcess.java
WorkerUtils.java
EnvConfigs.java
Pre-merge Checklist
Expand the relevant checklist and delete the others.
New Connector
Community member or Airbyter
airbyte_secret
./gradlew :airbyte-integrations:connectors:<name>:integrationTest
.README.md
bootstrap.md
. See description and examplesdocs/SUMMARY.md
docs/integrations/<source or destination>/<name>.md
including changelog. See changelog exampledocs/integrations/README.md
airbyte-integrations/builds.md
Airbyter
If this is a community PR, the Airbyte engineer reviewing this PR is responsible for the below items.
/test connector=connectors/<name>
command is passing./publish
command described hereUpdating a connector
Community member or Airbyter
airbyte_secret
./gradlew :airbyte-integrations:connectors:<name>:integrationTest
.README.md
bootstrap.md
. See description and examplesdocs/integrations/<source or destination>/<name>.md
including changelog. See changelog exampleAirbyter
If this is a community PR, the Airbyte engineer reviewing this PR is responsible for the below items.
/test connector=connectors/<name>
command is passing./publish
command described hereConnector Generator
-scaffold
in their name) have been updated with the latest scaffold by running./gradlew :airbyte-integrations:connector-templates:generator:testScaffoldTemplates
then checking in your changes