Status of testing of Apache Airflow 2.4.1rc1

[jedcunningham]

We have a kind request for all the contributors to the latest Apache Airflow RC 2.4.1rc1.

Could you please help us to test the RC versions of Airflow?

Please let us know in the comment if the issue is addressed in the latest RC.

• Fix Deferrable stuck as "scheduled" during backfill (#26205): @ephraimbuddy
• Don't update backfill run from the scheduler (#26342): @ephraimbuddy
• template rendering issue in passing templates_dict param using task decorator (#26390): @Bowrna @amaury-bhg
  Linked issues:
  • @task decorator does not handle "templates_exts" argument correctly (files are not rendered) (#22072)
• DAG Deps extends base_template (#26439): @jedcunningham
• Fix proper joining of the path for logs retrieved from celery workers (#26493): @potiuk
  Linked issues:
  • Properly build URL to retrieve logs independently from system (#26337)
  • Cannot fetch log from Celery worker (#26492)
• ExecutorConfigType should be cacheable (#26498): @dstandish
• Fix deadlock when mapped task with removed upstream is rerun (#26518): @ephraimbuddy
• fix WSGI root app (#26549): @sprohaska
• Correctly set json_provider_class on Flask app so it uses our encoder (#26554): @gfeldman @ashb
  Linked issues:
  • reverting json setting to use json_encoder despite warnings (#26546)
• Fix grid view log try numbers (#26556): @bbovenzi
• Log warning when secret backend kwargs is invalid (#26580): @uranusjr
• Allow MapXComArg to resolve after serialization (#26591): @uranusjr
• Resolve warning about DISTINCT ON query on dags view (#26608): @dstandish
  Linked issues:
  • resolve web ui views warning re DISTINCT ON (#26607)
• No missing user warning for public admin (#26611): @dstandish
• Resolve deprecation warning re Table.exists() (#26616): @dstandish
• Suppress SQLALCHEMY_TRACK_MODIFICATIONS warning in db init (#26617): @dstandish
  Linked issues:
  • Choose setting for sqlalchemy SQLALCHEMY_TRACK_MODIFICATIONS (#26544)
• Use COALESCE when ordering runs to handle NULL (#26626): @zachliu @uranusjr
  Linked issues:
  • The grid view shows incorrect DAG runs (#26505)
• Check user is active (#26635): @jedcunningham
• Fix xcom arg.py .zip bug (#26636): @BasPH @rjmcginness
  Linked issues:
  • Dynamic task mapping zip() iterates unexpected number of times (#26499)
• Fix scroll overflow for ConfirmDialog (#26681): @pierrejeambrun
• When rendering template, unmap task in context (#26702): @josh-fell @uranusjr
  Linked issues:
  • Unable to access operator attrs within Jinja context for mapped tasks (#24388)
• Fix PinotDB dependencies (#26705): @potiuk

Thanks to all who contributed to the release (probably not a complete list!):
@pierrejeambrun @jedcunningham @sprohaska @gfeldman @potiuk @Bowrna @bbovenzi @BasPH @ephraimbuddy @uranusjr @dstandish @josh-fell @amaury-bhg @ashb @zachliu @rjmcginness

[rjmcginness]

Tested fix (#26636) for issue #26499 in version 2.4.1rc1 and it seems to work for me. I'll defer to @BasPH to confirm. Hopefully, this is how I am supposed to respond here.

With patch:

Before patch:

[jedcunningham]

Thanks @rjmcginness 🍺!

[sprohaska]

Tested #26549. It works as expected.

[pierrejeambrun]

Tested #26681, working as expected :)

[zachliu]

#26626 works as expected

[raphaelauv]

test of "important" operators

[josh-fell]

#26702 works like a charm!

[jedcunningham]

Thanks everyone for testing this RC. 2.4.1 has now been released!