Skip to content

Conversation

@oyarushe
Copy link
Contributor

@oyarushe oyarushe commented Jul 12, 2021

It relates to issue #16949. It can't parse env file without sign = for each variable name.
I have checked for versions of Docker Compose: 1.29.2 and v2.0.0-beta.6.


^ Add meaningful description above

Read the Pull Request Guidelines for more information.
In case of fundamental code change, Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in UPDATING.md.

@potiuk
Copy link
Member

potiuk commented Jul 12, 2021

Oh boy!

@potiuk
Copy link
Member

potiuk commented Jul 12, 2021

🤦 for docker v2 to not handle this case. I think we should open an issue for that

@potiuk
Copy link
Member

potiuk commented Jul 12, 2021

I tested it with docker 2 and it works there too. Thanks for that investigation and fix @oyarushe !

@github-actions
Copy link

The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and take the risk. If they don't merge it quickly - please rebase it to the latest main at your convenience, or amend the last commit of the PR, and push it with --force-with-lease.

@potiuk
Copy link
Member

potiuk commented Jul 12, 2021

Created an issue in docker-archive/compose-cli#1917

@potiuk
Copy link
Member

potiuk commented Jul 12, 2021

BTW. You will need to rebase to latest main to get it works (drill operator added a dependency)

@potiuk
Copy link
Member

potiuk commented Jul 12, 2021

I merge it anyway - no problem with the failing tests.

@potiuk potiuk merged commit 83cb237 into apache:main Jul 12, 2021
@oyarushe oyarushe deleted the docker-compose-v2-issue branch July 12, 2021 19:43
potiuk added a commit to potiuk/airflow that referenced this pull request Jul 13, 2021
The apache#16950 aimed to fix an incompatibility introduced by
beta version of docker-compose v2 (which is automatically pushed
to MacOS users now).

The issue is documented in
docker-archive/compose-cli#1917

Unfortunately it has an undesired side-effect that the same file
cannot be used to specify list of variables for docker command
(the variables come empty).

Until the problem is solved, we need to keep two copies of those
variable files. Not ideal, but hopefully the issue will be solved
soon and we can go back to original env file in docker-compose v2.
potiuk added a commit that referenced this pull request Jul 13, 2021
The #16950 aimed to fix an incompatibility introduced by
beta version of docker-compose v2 (which is automatically pushed
to MacOS users now).

The issue is documented in
docker-archive/compose-cli#1917

Unfortunately it has an undesired side-effect that the same file
cannot be used to specify list of variables for docker command
(the variables come empty).

Until the problem is solved, we need to keep two copies of those
variable files. Not ideal, but hopefully the issue will be solved
soon and we can go back to original env file in docker-compose v2.
potiuk pushed a commit that referenced this pull request Jul 18, 2021
potiuk added a commit that referenced this pull request Jul 18, 2021
The #16950 aimed to fix an incompatibility introduced by
beta version of docker-compose v2 (which is automatically pushed
to MacOS users now).

The issue is documented in
docker-archive/compose-cli#1917

Unfortunately it has an undesired side-effect that the same file
cannot be used to specify list of variables for docker command
(the variables come empty).

Until the problem is solved, we need to keep two copies of those
variable files. Not ideal, but hopefully the issue will be solved
soon and we can go back to original env file in docker-compose v2.

(cherry picked from commit 72781c0)
josh-fell pushed a commit to josh-fell/airflow that referenced this pull request Jul 19, 2021
josh-fell pushed a commit to josh-fell/airflow that referenced this pull request Jul 19, 2021
The apache#16950 aimed to fix an incompatibility introduced by
beta version of docker-compose v2 (which is automatically pushed
to MacOS users now).

The issue is documented in
docker-archive/compose-cli#1917

Unfortunately it has an undesired side-effect that the same file
cannot be used to specify list of variables for docker command
(the variables come empty).

Until the problem is solved, we need to keep two copies of those
variable files. Not ideal, but hopefully the issue will be solved
soon and we can go back to original env file in docker-compose v2.
kaxil pushed a commit that referenced this pull request Aug 17, 2021
kaxil pushed a commit that referenced this pull request Aug 17, 2021
The #16950 aimed to fix an incompatibility introduced by
beta version of docker-compose v2 (which is automatically pushed
to MacOS users now).

The issue is documented in
docker-archive/compose-cli#1917

Unfortunately it has an undesired side-effect that the same file
cannot be used to specify list of variables for docker command
(the variables come empty).

Until the problem is solved, we need to keep two copies of those
variable files. Not ideal, but hopefully the issue will be solved
soon and we can go back to original env file in docker-compose v2.

(cherry picked from commit 72781c0)
jhtimmins pushed a commit that referenced this pull request Aug 17, 2021
jhtimmins pushed a commit that referenced this pull request Aug 17, 2021
The #16950 aimed to fix an incompatibility introduced by
beta version of docker-compose v2 (which is automatically pushed
to MacOS users now).

The issue is documented in
docker-archive/compose-cli#1917

Unfortunately it has an undesired side-effect that the same file
cannot be used to specify list of variables for docker command
(the variables come empty).

Until the problem is solved, we need to keep two copies of those
variable files. Not ideal, but hopefully the issue will be solved
soon and we can go back to original env file in docker-compose v2.

(cherry picked from commit 72781c0)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:dev-tools full tests needed We need to run full set of tests for this PR to merge

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants