Skip to content

Sync v2-8-stable with v2-8-test to release 2.8.2#37563

Merged
ephraimbuddy merged 169 commits intov2-8-stablefrom
v2-8-test
Feb 22, 2024
Merged

Sync v2-8-stable with v2-8-test to release 2.8.2#37563
ephraimbuddy merged 169 commits intov2-8-stablefrom
v2-8-test

Conversation

@ephraimbuddy
Copy link
Contributor

Time for 2.8.2rc1!

Copy link
Member

@hussein-awala hussein-awala left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@ephraimbuddy ephraimbuddy force-pushed the v2-8-test branch 2 times, most recently from 8008ed7 to ab42fb3 Compare February 21, 2024 17:26
@ephraimbuddy ephraimbuddy force-pushed the v2-8-test branch 3 times, most recently from ac35b0b to 01af909 Compare February 21, 2024 20:51
…36819)

The source-tarball that was supposed to be reproducible, was
"almost" reproducible. It turned out that we forgot that group
permissions are bound to change depending on the umask that is
configured in the system (because using umask is the default git
configuration when files are checked out). This means that the
packages were reproducible only if the two people who built it
had the same umask set.

Since it is unlikely that default owner umask is different than
rwx allowed, all the tools that are bound to provide reproducibility
approach it via setting the umask to clear any permissions for group
and other - this way the files in archive have only owner permissions
set.

This is what this PR does - we set the tar.umask when running the
`git archive` command to 0077 which effectively cleans all the group
and other permissions.

In this PR we also fix FutureDeprecation warning raised in newer
versions of Python where GzipFile should take keyword parameters
rather than positional ones.

(cherry picked from commit d5c0f32)
(cherry picked from commit e99cfbb)
amoghrajesh and others added 27 commits February 22, 2024 07:50
* Fixing status icon alignment

* review from pierre

(cherry picked from commit 5407318)
It's been moved recently, so if someone built airflow before, this
file might still be around, we should just ignore it.

(cherry picked from commit 8664ef2)
* use type instead of isinstance

* add tests

(cherry picked from commit 7f44d9b)
At shutdown, a trigger may emit a "close" signal around the same time as logging.shutDown is called, so the handler may have been removed from the handlers by one thread when the other tries to delete it.

(cherry picked from commit e24f0a9)
(cherry picked from commit daa2bce)
Co-authored-by: Vincent Kling <v.kling@vinniict.nl>
(cherry picked from commit 70e55e5)
When we created a new folder during log file handler directory creation
we did not change the permissions of parent folders.

Fixes: #37200
(cherry picked from commit aae4a83)
* treeview - determinist and new getter

* review 1

---------

Co-authored-by: raphaelauv <raphaelauv@users.noreply.github.com>
(cherry picked from commit 0c02ead)
Fix typo

(cherry picked from commit 27c6ffd)
The changes in #37320 introduced flakiness while removing side-effect
of configuration test. Cleanup of ProvidersManager might
interfere with other tests using it at the same time. This caused
some Non-DB test failures with missing keys in ProvidersManager.

The fix is to mark the configuration test as DB-test - then it
will never be run by NonDB xdist and it will always run
sequentially to other tests (and still it will not
introduce side-effect as cleanup will always be done between tests.

(cherry picked from commit cbc9af0)
* add redirect

* change order

(cherry picked from commit 4b0c3e7)
* Remove `markdown` from core dependencies

* Apply suggestions from code review

Co-authored-by: Jarek Potiuk <jarek@potiuk.com>

---------

Co-authored-by: Jarek Potiuk <jarek@potiuk.com>
(cherry picked from commit 8b6f448)
Some of the providers need to be currently excluded from Python 3.12
because they have conflicting dependencies. While we are working on
Python 3.12 support in #36755, in order to install airflow (for
caching purposes) from GitHub URL, we need to separately merge the
exclusions to main - this will help to build Python 3.12 CI
image with all necessary dependencies cached.

(cherry picked from commit b53fe08)
* Update fundamentals.rst

* Update docs/apache-airflow/tutorial/fundamentals.rst

Co-authored-by: Wei Lee <weilee.rx@gmail.com>

---------

Co-authored-by: Jarek Potiuk <jarek@potiuk.com>
Co-authored-by: Wei Lee <weilee.rx@gmail.com>
(cherry picked from commit 86f4775)
Bumps [undici](https://github.com/nodejs/undici) from 5.26.3 to 5.28.3.
- [Release notes](https://github.com/nodejs/undici/releases)
- [Commits](nodejs/undici@v5.26.3...v5.28.3)

---
updated-dependencies:
- dependency-name: undici
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
(cherry picked from commit 1376876)
Namedtuple is serialized like 'builtins.tuple'

The serialize method (in airflow/serialization/serializers/builtin.py) does qualname() on the namedtuple, which returns an arbitrary name. If this is used as classname, it will fail to deserialize: there won't be any deserializer for it.

(cherry picked from commit c49f857)
* Fix upgrade docs to reflect true cli arguments available

* Add in to version for parity

* Use shortened flag in first example

(cherry picked from commit 4778c49)
…x_active_runs reached its upper limit. (#31414)" (#37596)

This reverts commit b53e2ae.

(cherry picked from commit b38d59b)
Code that normally catches Exception should not implicitly ignore
interrupts from AirflowTaskTimout.

Fixes #35644 #35474

(cherry picked from commit 581e2e4)
@ephraimbuddy ephraimbuddy merged commit 2c0a119 into v2-8-stable Feb 22, 2024
@potiuk
Copy link
Member

potiuk commented Feb 22, 2024

🎉

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:dev-tools area:production-image Production image improvements and fixes

Projects

None yet

Development

Successfully merging this pull request may close these issues.