From 24297fa5275ac6069b1ca88d2bbf64ab825c8c3e Mon Sep 17 00:00:00 2001 From: Matt Butrovich Date: Wed, 3 Jun 2026 13:08:30 -0400 Subject: [PATCH 1/2] Update changelog after backports. --- dev/changelog/54.0.0.md | 26 +++++++++++++++++++------- 1 file changed, 19 insertions(+), 7 deletions(-) diff --git a/dev/changelog/54.0.0.md b/dev/changelog/54.0.0.md index 22382d868365e..6bcbaee82f6dd 100644 --- a/dev/changelog/54.0.0.md +++ b/dev/changelog/54.0.0.md @@ -19,7 +19,7 @@ under the License. # Apache DataFusion 54.0.0 Changelog -This release consists of 727 commits from 139 contributors. See credits at the end of this changelog for more information. +This release consists of 739 commits from 139 contributors. See credits at the end of this changelog for more information. See the [upgrade guide](https://datafusion.apache.org/library-user-guide/upgrading.html) for information on how to upgrade from previous versions. @@ -415,6 +415,9 @@ See the [upgrade guide](https://datafusion.apache.org/library-user-guide/upgradi - chore(deps): update myst-parser requirement from <6,>=5 to >=5.1.0,<6 in /docs [#22378](https://github.com/apache/datafusion/pull/22378) (dependabot[bot]) - feat(functions-nested): add array_filter higher-order function [#21895](https://github.com/apache/datafusion/pull/21895) (ologlogn) - Add SQL as a category in breaking API change policy [#22179](https://github.com/apache/datafusion/pull/22179) (alamb) +- [branch-54] Bump to version 54.0.0 [#22396](https://github.com/apache/datafusion/pull/22396) (mbutrovich) +- [branch-54] Revert "Add `ExecutionPlan::apply_expressions()` (#20337)" (#22437) [#22445](https://github.com/apache/datafusion/pull/22445) (alamb) +- [branch-54] Gate new ScalarSubqueryExec node behind session property (#22530) [#22690](https://github.com/apache/datafusion/pull/22690) (LiaCastaneda) **Other:** @@ -766,6 +769,15 @@ See the [upgrade guide](https://datafusion.apache.org/library-user-guide/upgradi - fix regexp_count should count empty-pattern matches [#22311](https://github.com/apache/datafusion/pull/22311) (xiedeyantu) - Actually preserve predicate execution order in PushDownFilter [#21643](https://github.com/apache/datafusion/pull/21643) (joroKr21) - chore(deps): bump qs and body-parser in /datafusion/wasmtest/datafusion-wasm-app [#22321](https://github.com/apache/datafusion/pull/22321) (dependabot[bot]) +- [branch-54] add changelog [#22402](https://github.com/apache/datafusion/pull/22402) (mbutrovich) +- [branch-54]: Backport 22404. Fix Spark slice function on negative OOB [#22443](https://github.com/apache/datafusion/pull/22443) (comphead) +- [branch-54] Cherry-pick #22493: restore SortExec elimination after stats-based file reorder [#22501](https://github.com/apache/datafusion/pull/22501) (zhuqi-lucas) +- [branch-54] Fix: compact view buffers in ScalarValue::compact for all container types (#21934) [#22446](https://github.com/apache/datafusion/pull/22446) (alamb) +- [branch-54] Support transparent ExecutionPlan downcasts [#22565](https://github.com/apache/datafusion/pull/22565) (geoffreyclaude) +- [branch-54] Fix TopK DISTINCT aggregation preserving NULLs (#22571) [#22634](https://github.com/apache/datafusion/pull/22634) (alamb) +- [branch-54] refactor: wrap HigherOrderUDFImpl in a concrete HigherOrderUDF struct (#22593) [#22635](https://github.com/apache/datafusion/pull/22635) (alamb) +- [branch-54] chore: Cleanup and refactor `build_join` in `ScalarSubqueryToJoin` (#… [#22693](https://github.com/apache/datafusion/pull/22693) (LiaCastaneda) +- [branch-54] fix: clear handled OFFSET before child recursion in LimitPushdown (#22525) [#22631](https://github.com/apache/datafusion/pull/22631) (alamb) ## Credits @@ -774,16 +786,16 @@ Thank you to everyone who contributed to this release. Here is a breakdown of co ``` 70 Neil Conway 68 dependabot[bot] - 51 Andrew Lamb + 56 Andrew Lamb 26 Burak Şen - 25 Oleks V + 26 Oleks V 21 Daniël Heres 20 Adrian Garcia Badaracco 18 Kumar Ujjawal + 17 Matt Butrovich 16 kosiew - 15 Matt Butrovich + 15 Qi Zhu 15 Tim Saucer - 14 Qi Zhu 14 Zhen Chen 13 Dmitrii Blaginin 13 Jeffrey Vo @@ -804,22 +816,22 @@ Thank you to everyone who contributed to this release. Here is a breakdown of co 5 Alfonso Subiotto Marqués 5 Bruce Ritchie 5 Liang-Chi Hsieh + 5 Lía Adriana 5 Nuno Faria 5 Sergei Grebnov 4 Andy Grove 4 Ariel Miculas-Trif + 4 Geoffrey Claude 4 Jayant Shrivastava 4 Kevin Liu 4 lyne 3 Brent Gardner 3 David López 3 Dewey Dunnington - 3 Geoffrey Claude 3 Harrison Crosse 3 Huy Mac 3 Kazantsev Maksim 3 Konstantin Tarasov - 3 Lía Adriana 3 Namgung Chan 3 Peter L 3 RIchard Baah From 5e6bca201d101d6d29ece260cbc7b9e1a155a6f5 Mon Sep 17 00:00:00 2001 From: Andrew Lamb Date: Wed, 3 Jun 2026 18:01:25 -0400 Subject: [PATCH 2/2] chore: Update with latest count --- dev/changelog/54.0.0.md | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-) diff --git a/dev/changelog/54.0.0.md b/dev/changelog/54.0.0.md index 6bcbaee82f6dd..4bae126539c84 100644 --- a/dev/changelog/54.0.0.md +++ b/dev/changelog/54.0.0.md @@ -19,7 +19,7 @@ under the License. # Apache DataFusion 54.0.0 Changelog -This release consists of 739 commits from 139 contributors. See credits at the end of this changelog for more information. +This release consists of 740 commits from 139 contributors. See credits at the end of this changelog for more information. See the [upgrade guide](https://datafusion.apache.org/library-user-guide/upgrading.html) for information on how to upgrade from previous versions. @@ -778,6 +778,7 @@ See the [upgrade guide](https://datafusion.apache.org/library-user-guide/upgradi - [branch-54] refactor: wrap HigherOrderUDFImpl in a concrete HigherOrderUDF struct (#22593) [#22635](https://github.com/apache/datafusion/pull/22635) (alamb) - [branch-54] chore: Cleanup and refactor `build_join` in `ScalarSubqueryToJoin` (#… [#22693](https://github.com/apache/datafusion/pull/22693) (LiaCastaneda) - [branch-54] fix: clear handled OFFSET before child recursion in LimitPushdown (#22525) [#22631](https://github.com/apache/datafusion/pull/22631) (alamb) +- [branch-54] refactor: give parquet CDC options an explicit `enabled` flag (backport #22632) [#22648](https://github.com/apache/datafusion/pull/22648) (kszucs) ## Credits @@ -849,6 +850,7 @@ Thank you to everyone who contributed to this release. Here is a breakdown of co 2 Frederic Branczyk 2 Geethapranay1 2 Jonah Gao + 2 Krisztián Szűcs 2 Liam Feehery 2 Marko Grujic 2 Michael Kleen @@ -897,7 +899,6 @@ Thank you to everyone who contributed to this release. Here is a breakdown of co 1 Kartik Gupta 1 Krishna Sudarshan J 1 Kristin Cowalcijk - 1 Krisztián Szűcs 1 Lavkesh Lahngir 1 Martin Hilton 1 Mason