Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Specific use-case: adding packages via requirements.txt in compose #29598

Conversation

potiuk
Copy link
Member

@potiuk potiuk commented Feb 17, 2023

The users of docker compose do not realise that docker compose has built-in mechanism for rebuilding the image automatically when needed and do not realise that this does not make their workflows more complex. Apparently just describing how you can use custom images is either scary or not clear enough, as users keep on for dynamic way of adding the packages (which makes no sense if you use what docker-compose provides out-of-the-box) so it is worthwile to specifically mention "requirements.txt" and explicitly add all the steps needed to make requirements.txt and custom Docker image part of your regular workflow.


^ Add meaningful description above

Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

@potiuk
Copy link
Member Author

potiuk commented Feb 17, 2023

Looks like we need to be even more explicit about that one: #29597

Copy link
Member

@pierrejeambrun pierrejeambrun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this is a good addition, we regularly have questions about this on the slack as well, thanks :)

The users of docker compose do not realise that docker compose
has built-in mechanism for rebuilding the image automatically when
needed and do not realise that this does not make their workflows
more complex. Apparently just describing how you can use custom
images is either scary or not clear enough, as users keep on for
dynamic way of adding the packages (which makes no sense if you
use what docker-compose provides out-of-the-box) so it is
worthwile to specifically mention "requirements.txt" and
explicitly add all the steps needed to make requirements.txt and
custom Docker image part of your regular workflow.
@potiuk potiuk force-pushed the clarify-special-case-for-docker-compose-custom-image branch from a063d70 to 7b61d36 Compare February 19, 2023 15:35
@potiuk
Copy link
Member Author

potiuk commented Feb 19, 2023

All comments reflected and docs building fixed. Merging

@potiuk potiuk merged commit a21c17b into apache:main Feb 19, 2023
@potiuk potiuk deleted the clarify-special-case-for-docker-compose-custom-image branch February 19, 2023 18:09
@pierrejeambrun pierrejeambrun added the type:doc-only Changelog: Doc Only label Feb 27, 2023
@pierrejeambrun pierrejeambrun added this to the Airflow 2.5.2 milestone Feb 27, 2023
pierrejeambrun pushed a commit that referenced this pull request Mar 7, 2023
…29598)

The users of docker compose do not realise that docker compose
has built-in mechanism for rebuilding the image automatically when
needed and do not realise that this does not make their workflows
more complex. Apparently just describing how you can use custom
images is either scary or not clear enough, as users keep on for
dynamic way of adding the packages (which makes no sense if you
use what docker-compose provides out-of-the-box) so it is
worthwile to specifically mention "requirements.txt" and
explicitly add all the steps needed to make requirements.txt and
custom Docker image part of your regular workflow.

(cherry picked from commit a21c17b)
pierrejeambrun pushed a commit that referenced this pull request Mar 8, 2023
…29598)

The users of docker compose do not realise that docker compose
has built-in mechanism for rebuilding the image automatically when
needed and do not realise that this does not make their workflows
more complex. Apparently just describing how you can use custom
images is either scary or not clear enough, as users keep on for
dynamic way of adding the packages (which makes no sense if you
use what docker-compose provides out-of-the-box) so it is
worthwile to specifically mention "requirements.txt" and
explicitly add all the steps needed to make requirements.txt and
custom Docker image part of your regular workflow.

(cherry picked from commit a21c17b)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants