Skip to content

Comments

Add root volume for airflow to keep generated config in breeze#47228

Merged
potiuk merged 1 commit intoapache:mainfrom
potiuk:add-root-volume-for-airflow
Mar 1, 2025
Merged

Add root volume for airflow to keep generated config in breeze#47228
potiuk merged 1 commit intoapache:mainfrom
potiuk:add-root-volume-for-airflow

Conversation

@potiuk
Copy link
Member

@potiuk potiuk commented Feb 28, 2025

When configuration is generated by airflow it should be kept persistent between runs because it contains jwt_secret and fernet key that is then used to encrypt/decrypt the data (see #46966). This PR makes the config file persistent between runs, so that the data stored in the db and jwt_secrets can remain persistent.

The breeze down will delete those - but they also delete the db, so syncing of the keys in config and db is "given".


^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

When configuration is generated by airflow it should be kept persistent
between runs because it contains jwt_secret and fernet key that is then used
to encrypt/decrypt the data (see apache#46966). This PR makes the config file
persistent between runs, so that the data stored in the db and
jwt_secrets can remain persistent.

The `breeze down` will delete those - but they also delete the db, so
syncing of the keys in config and db is "given".
@potiuk
Copy link
Member Author

potiuk commented Feb 28, 2025

Better support for airflow 3 generated configuration / jwt_secrets persisted between breeze runs

Copy link
Contributor

@jscheffl jscheffl left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good idea! Thanks for the improvement!

Copy link
Member

@gopidesupavan gopidesupavan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

cool :)

@potiuk potiuk merged commit 6e7c5f1 into apache:main Mar 1, 2025
89 checks passed
@potiuk potiuk deleted the add-root-volume-for-airflow branch March 1, 2025 12:11
Copy link
Contributor

@vincbeck vincbeck left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice!

shahar1 pushed a commit to shahar1/airflow that referenced this pull request Mar 5, 2025
…e#47228)

When configuration is generated by airflow it should be kept persistent
between runs because it contains jwt_secret and fernet key that is then used
to encrypt/decrypt the data (see apache#46966). This PR makes the config file
persistent between runs, so that the data stored in the db and
jwt_secrets can remain persistent.

The `breeze down` will delete those - but they also delete the db, so
syncing of the keys in config and db is "given".
nailo2c pushed a commit to nailo2c/airflow that referenced this pull request Apr 4, 2025
…e#47228)

When configuration is generated by airflow it should be kept persistent
between runs because it contains jwt_secret and fernet key that is then used
to encrypt/decrypt the data (see apache#46966). This PR makes the config file
persistent between runs, so that the data stored in the db and
jwt_secrets can remain persistent.

The `breeze down` will delete those - but they also delete the db, so
syncing of the keys in config and db is "given".
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants