We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
2.3.3
Nested values, such as env_vars for the KubernetesPodOperater are not being rendered when used as a dynamically mapped operator.
env_vars
KubernetesPodOperater
Assuming the following:
op = KubernetesPodOperater.partial( env_vars=[k8s.V1EnvVar(name='AWS_ACCESS_KEY_ID', value='{{ var.value.aws_access_key_id }}')], # Other arguments ).expand(arguments=[[1], [2]])
The Rendered Template results for env_vars should be:
("[{'name': 'AWS_ACCESS_KEY_ID', 'value': 'some-super-secret-value', 'value_from': None}]")
Instead the actual Rendered Template results for env_vars are un-rendered:
("[{'name': 'AWS_ACCESS_KEY_ID', 'value': '{{ var.value.aws_access_key_id }}', 'value_from': None}]")
This is probably caused by the fact that MappedOperator is not calling KubernetesPodOperater._render_nested_template_fields.
MappedOperator
KubernetesPodOperater._render_nested_template_fields
No response
Ubuntu 18.04
Other 3rd-party Helm chart
The text was updated successfully, but these errors were encountered:
MappedOperator inherits AbstractOperator, which calls _render_nested_template_fields via render_template. So the analysis seems off.
_render_nested_template_fields
render_template
Sorry, something went wrong.
Does this work?
KubernetesPodOperater( task_id=..., ..., env_vars=[k8s.V1EnvVar(name='AWS_ACCESS_KEY_ID', value='{{ var.value.aws_access_key_id }}')], )
Does this work? KubernetesPodOperater( task_id=..., ..., env_vars=[k8s.V1EnvVar(name='AWS_ACCESS_KEY_ID', value='{{ var.value.aws_access_key_id }}')], )
Yes, as mentioned above the issue is only when using the operator as a mapped-operator.
Successfully merging a pull request may close this issue.
Apache Airflow version
2.3.3
What happened
Nested values, such as
env_vars
for theKubernetesPodOperater
are not being rendered when used as a dynamically mapped operator.Assuming the following:
The Rendered Template results for
env_vars
should be:Instead the actual Rendered Template results for
env_vars
are un-rendered:This is probably caused by the fact that
MappedOperator
is not callingKubernetesPodOperater._render_nested_template_fields
.What you think should happen instead
No response
How to reproduce
No response
Operating System
Ubuntu 18.04
Versions of Apache Airflow Providers
No response
Deployment
Other 3rd-party Helm chart
Deployment details
No response
Anything else
No response
Are you willing to submit PR?
Code of Conduct
The text was updated successfully, but these errors were encountered: