v1.7.0-rc1

What's Changed

• [CORE] Bump version to 1.7.0-SNAPSHOT by @zhztheplayer in #11592
• [GLUTEN-11611][VL] Temporary disable GPU CI job by @zhouyuan in #11612
• [GLUTEN-10215][VL] Delta write: Native statistics tracker to eliminate C2R overhead by @zhztheplayer in #11419
• [GLUTEN-4836][VL] Enable Rank and DenseRank for WindowGroupLimitExec by @zhouyuan in #11567
• [VL] docs: Update Velox fork reference from oap-project to IBM. by @satyakommula96 in #11610
• [VL] Gluten-it: Several enhancements by @zhztheplayer in #11600
• [MINOR][VL] Fix throw-new anti-pattern in FileReaderIterator.cc by @acvictor in #11620
• [MINOR][VL] Replace C-style casts with C++ casts in shuffle writers by @acvictor in #11621
• [MINOR][VL] Use resize() instead of reserve() in getEmitInfo by @acvictor in #11623
• [GLUTEN-11622][VL] Fallback TimestampNTZ to Spark by @acvictor in #11609
• [MINOR] Fix ZipFile resource leak in ResourceUtil by @acvictor in #11617
• [MINOR] Use build/mvn wrapper in release scripts by @yaooqinn in #11625
• [GLUTEN-6887][VL] Daily Update Velox Version (2026_02_17) by @GlutenPerfBot in #11624
• [GLUTEN-6887][VL] Daily Update Velox Version (2026_02_23) by @GlutenPerfBot in #11640
• [GLUTEN-11422][VL] Update ORC related Spark unit tests for Spark 3.5+ by @loudongfeng in #11423
• [VL] Various fixes for gluten-it by @zhztheplayer in #11642
• [GLUTEN-11088][VL] Bump scala maven plugin to align with Spark by @zhouyuan in #11581
• [VL] Support function ToPrettyString by @jinchengchenghh in #11566
• [GLUTEN-6887][VL] Daily Update Velox Version (2026_02_24) by @GlutenPerfBot in #11646
• [MINOR] Upgrade actions/checkout from v2/v3 to v4 by @acvictor in #11627
• [CORE] Use ArrayList instead of LinkedList in Spillers by @acvictor in #11619
• [MINOR] Fix run-scala-test.sh to always use build/mvn for JVM args extraction by @baibaichen in #11598
• [CORE] Add Bloop integration for faster Scala incremental compilation by @liuneng1994 in #11645
• [GLUTEN-11559][VL] Add incremental C++ build script for fast development iteration by @baibaichen in #11595
• [VL] Initialize typeConvertor_ in VeloxToSubstraitExprConvertor by @acvictor in #11654
• [MINOR] Use build/mvn wrapper in CI cache workflow by @yaooqinn in #11644
• [GLUTEN-11550][UT][Spark4.x] Remove GlutenSingleLevelAggregateHashMapSuite, GlutenTwoLevelAggregateHashMapSuite, GlutenTwoLevelAggregateHashMapWithVectorizedMapSuite by @kapilks in #11571
• [MINOR] Add missing Delta Lake derived file to LICENSE by @weiting-chen in #11662
• [MINOR] Add bundled test JAR to LICENSE by @weiting-chen in #11663
• [VL] Fix oom when plan is large by @boneanxs in #11652
• [GLUTEN-11658][CORE] Restore scala.recompile.mode default to 'all' and introduce fast-build profile by @baibaichen in #11659
• [Minor][VL]feat: Relax the restrict since velox-cudf supports reading part parquet file by @jinchengchenghh in #11660
• [VL] Remove rule PullOutDuplicateProject by @zml1206 in #11667
• [GLUTEN-11513][CORE] Add null checks and improve JNI listener initialization in JniCommon.h by @ReemaAlzaid in #11664
• Bump pillow from 10.3.0 to 12.1.1 in /tools/workload/benchmark_velox/analysis by @dependabot[bot] in #11650
• Bump nbconvert from 7.16.4 to 7.17.0 in /tools/workload/benchmark_velox/analysis by @dependabot[bot] in #11649
• [VL] Add Spark randstr function mapping for Velox backend by @yaooqinn in #11607
• [GLUTEN-11550][UT] Enable GlutenXmlExpressionsSuite for spark4x and exclude 'from_xml- invalid data' by @baibaichen in #11580
• [VL][TEST] Add test for aggregate with duplicate project by @zml1206 in #11440
• [BUILD] Upgrade Scala 2.12 version to 2.12.18 to support JDK 21 by @liujiayi771 in #11666
• [VL] Reduce triple map lookup to single find in dictionary serialization by @acvictor in #11628
• [GLUTEN-11611][VL] Enable GPU build CI by @jinchengchenghh in #11668
• [VL][DOCS] update doc with supported ABFS authentication mechanisms by @pratham76 in #11675
• [VL] Initialize typeConvertor_ in VeloxToSubstraitPlanConvertor by @acvictor in #11682
• [GLUTEN-10903][VL] Build cudf always by @jinchengchenghh in #11691
• [MINOR][VL] Add iceberg test for spark40 enhanced features by @jinchengchenghh in #11661
• [Minor][VL] Remove unused compile option VELOX_ENABLE_GPU by @jinchengchenghh in #11690
• [VL] Adding nightly package for enhanced features by @zhouyuan in #11528
• [INFRA] Cleanup for TLP release process by @zhztheplayer in #11696
• [GLUTEN-6887][VL] Daily Update Velox Version (2026_03_03) by @GlutenPerfBot in #11688
• [VL] Metrics: Fix scan remaining filter time is zero by @zhztheplayer in #11706
• [GLUTEN-11402][VL] Fix decimal partition key serialization to preserve scale by @acvictor in #11618
• [GLUTEN-11379][CORE] Clean up Spark shims APIs following Spark 3.2 deprecation by @philo-he in #11687
• [VL] Fix docker build by @zhouyuan in #11608
• [GLUTEN-11588][FLINK] Support rocksdb state for window operator by @KevinyhZou in #11589
• [INFRA] Add deletion vector .bin test data files to LICENSE by @weiting-chen in #11707
• [INFRA] Update release scripts for 4.0 by @zhztheplayer in #11704
• [GLUTEN-11683][VL] Enable GlutenParquetTypeWideningSuite for Spark 4.0 and 4.1 by @baibaichen in #11684
• [GLUTEN-6887][VL] Daily Update Velox Version (2026_03_08) by @GlutenPerfBot in #11717
• [VL] Allocate VarChar sub-messages on protobuf arena in VeloxToSubstraitExpr by @acvictor in #11636
• [GLUTEN-7548][VL] Optimize BHJ in velox backend by @JkSelf in #8931
• [GLUTEN-11635] Enable partial fallback if parent node supports partial fallback by @wecharyu in #11637
• [CORE] Refactor task error logging into dedicated utility class by @pratham76 in #11718
• [GLUTEN-11699][VL] Add support for S3 IMDS configuration by @sh-shamsan in #11721
• [MINOR] Respect Spark bloom filter config by @jinchengchenghh in #11561
• [GLUTEN-7548][VL] Follow up hash join optimization PR 8931 to resolve comments by @JkSelf in #11728
• [GLUTEN-6887][VL] Daily Update Velox Version (2026_03_10) by @GlutenPerfBot in #11730
• [GLUTEN-11316][VL] Followup to fix spark-4.1 nightly package by @zhouyuan in #11744
• [GLUTEN-11550][VL] Enable GlutenDataFrameSubquerySuite for Spark 4.1 by @baibaichen in #11727
• [VL] Enable assert_not_null expression for Velox backend by @yaooqinn in #11685
• [GLUTEN-11550][UT] Enable GlutenXmlFunctionsSuite for Spark 4.0 and 4.1 by @baibaichen in #11725
• [GLUTEN-6887][VL] Daily Update Velox Version (2026_03_11) by @GlutenPerfBot in #11736
• [GLUTEN-11740][VL] Bump folly to v2026.01.05 by @zhouyuan in #11745
• Update dev scripts and Dockerfiles for TLP graduation by @weiting-chen in #11742
• Remove DISCLAIMER file after TLP graduation by @weiting-chen in #11738
• Update release scripts and template for TLP graduation by @weiting-chen in #11739
• [CORE] Remove remaining Spark 3.2 compatibility code by @QCLyu in #11731
• [CORE] Fix AssertNotNull mapping by @zml1206 in #11749
• [GLUTEN-11605][VL] Push dynamic filters down to ValueStream by @acvictor in #11657
• fix: redact credentials from repo URL in gluten-build-info.properties by @xumingming in #11751
• [VL] Add VeloxDelta.md for Delta Lake feature support by @zhztheplayer in #11733
• [GLUTEN-8821][VL] tools: fix gen function support script by @zhouyuan in #11732
• [MINOR] Lazy set the numBytes of ColumnarBatch by @jinchengchenghh in #11759
• [GLUTEN-11578][CORE] Remove RAS by @zhztheplayer in #11756
• [GLUTEN-10933][VL] feat: Support cached the batches in cpu cache by @jinchengchenghh in #11758
• [GLUTEN-9456][VL] Cancel load earlier in GlutenDirectBufferedInput destructor by @rui-mo in #11697
• Remove Incubating references from source code by @weiting-chen in #11737
• Update GitHub CI workflows for TLP graduation by @weiting-chen in #11741
• [GLUTEN-6887][VL] Daily Update Velox Version (2026_03_13) by @GlutenPerfBot in #11755
• [GLUTEN-11692][CORE] Driver side should avoid submitting subqueries while validating file formats by @beliefer in #11748
• [CI] Fix the concurrency of code format check by @jinchengchenghh in #11760
• [VL] Gluten-it: Vairous fixes by @zhztheplayer in #11768
• [GLUTEN-11658][VL] Add missing direct dependency for each module by @zhouyuan in #11681
• [VL] Close ColumnarBatch in ColumnarCollectLimitExec for skipped batches by @acvictor in #11754
• [GLUTEN-6887][VL] Daily Update Velox Version (2026_03_15) by @GlutenPerfBot in #11764
• Update repository references from incubator-gluten to gluten after TLP graduation by @weiting-chen in #11735
• [GLUTEN-DOCS] Fix broken mkdocs navigation and add getting-started guide by @acvictor in #11772
• [CH] Remove RAS by @zml1206 in #11773
• [VL] Adding configurations on max write file size by @zhouyuan in #11606
• [CORE] Refactor ExpressionConverter to use explicit Option return instead of Option(null) by @acvictor in #11757
• [GLUTEN-11513][VL][Iceberg] Fix input_file_name() on Iceberg, JNI init stability, and metadata propagation by @ReemaAlzaid in #11615
• [VL] Gluten-it: Fix broken --decimal-as-double by @zhztheplayer in #11781
• [MINOR] Fix gpu fallback by @jinchengchenghh in #11785
• [MINOR] Fix Link to Package Repository in README by @sujithjay in #11786
• [INFRA] Fix Scala 2.13 build on JDK 8 by using release 8 instead of 1.8 by @zml1206 in #11784
• Only apply VeloxParquetWriterInjects and NativeWritePostRule for Spark 3.3 by @JkSelf in #11787
• [GLUTEN-11550][VL][UT] Enable Variant test suites by @baibaichen in #11726
• [GLUTEN-11550][UT] Fix PlanStability test suites for Velox backend by @baibaichen in #11799
• [VL] Reuse byte[] buffers in shuffle read and broadcast serialization paths by @acvictor in #11777
• [GLUTEN-8227][VL] fix: Update sort elimination rules for Hash Aggregate by @acvictor in #9473
• [GLUTEN-11550][UT] Replace GlutenTestsCommonTrait with correct Gluten test traits for Spark 4.0/4.1 by @baibaichen in #11800
• [GLUTEN-11797][CORE] Improve the performance of getDistinctPartitionReadFileFormats for HiveTableScanExecTransformer by @beliefer in #11798
• [GLUTEN-11550][UT] Enable GlutenMergeIntoDataFrameSuite and GlutenSparkSessionJobTaggingAndCancellationSuite by @baibaichen in #11812
• [VL] Remove dead config spark.gluten.velox.fs.s3a.connect.timeout by @xumingming in #11810
• [VL] Use CPUThreadPoolExecutor as DBI executors by @FelixYBW in #11811
• [VL] Enhance VeloxS3 documentation with config details by @FelixYBW in #11806
• [GLUTEN-11550][UT] Add golden file comparison for PlanStability test suites by @baibaichen in #11805
• [GLUTEN-11766][VL] Implement the executeCollect() method in ColumnarCollectLimitExec by @JkSelf in #11802
• [SETUP] Use #!/usr/bin/env bash instead of #!/bin/bash in scripts by @Zouxxyy in #11778
• [CH] Close ColumnarBatch in CHColumnarCollectLimitExec for skipped batches by @acvictor in #11818
• [GLUTEN-6887][VL] Daily Update Velox Version (2026_03_24) by @GlutenPerfBot in #11817
• [CORE] Remove empty companion objects by @acvictor in #11822
• [VL] Pass row count to CudfVector in GPU batch serializer by @acvictor in #11831
• [GLUTEN-11316][VL] Keep old 4.x packages when building for new package by @zhouyuan in #11820
• Bump black from 24.4.2 to 26.3.1 in /tools/workload/benchmark_velox/analysis by @dependabot[bot] in #11814
• [VL] Support Spark map_from_entries function by @philo-he in #8731
• [MINOR][VL] Add cudf build docker file with JDK 17 and cuda 12.9 by @jinchengchenghh in #11836
• [GLUTEN-11379][VL] remove banned class from spark-32 build by @zhouyuan in #11840
• Bump requests from 2.32.4 to 2.33.0 in /tools/workload/benchmark_velox/analysis by @dependabot[bot] in #11842
• [VL] Enable native Parquet write for complex types (Struct/Array/Map) by @Zouxxyy in #11788
• Bump pyasn1 from 0.4.8 to 0.6.3 in /tools/workload/benchmark_velox/analysis by @dependabot[bot] in #11846
• [VL] Gluten-it: Rename column c_last_review_date to c_last_review_date_sk by @zhztheplayer in #11792
• [DOC] Update documentation for Spark version support and TLP graduation by @acvictor in #11851
• [GLUTEN-11550][VL] Enable GlutenLogicalPlanTagInSparkPlanSuite (150/150 tests) by @baibaichen in #11833
• [VL] Clean up GPU code: remove dead/redundant code by @acvictor in #11824
• [GLUTEN-1433] [VL] Add validation tests for CurrentTimestamp and now(foldable) by @Mariamalmesfer in #11656
• [GLUTEN-11796][VL] Teardown the AWS SDK by @rui-mo in #11857
• [VL] Fix StdMemoryAllocator::allocateZeroFilled byte accounting by @LuciferYang in #11855
• [VL] Fix native Union result name by @lifulong in #11832
• [VL][CI] Adding docker image for maven cache by @sh-shamsan in #11655
• [VL] Refine logs by @JkSelf in #11870
• [GLUTEN-11872][VL] Fix docker build by @zhouyuan in #11873
• [GLUTEN-6887][VL] Daily Update Velox Version (2026_04_01) by @GlutenPerfBot in #11860
• [GLUTEN-11678][VL] Native validation should check CrossRelNode's expression by @wecharyu in #11679
• [GLUTEN-11872][VL] Fix docker metadata action version by @zhouyuan in #11875
• [VL] Use UnboundedBlockingQueue when create threads pool by @FelixYBW in #11877
• [MINOR] Expose Gluten and component build information to SparkConf by @jiangjiangtian in #11838
• [GLUTEN-1433] [VL] Add config to disable TimestampNTZ validation fallback by @Mariamalmesfer in #11720
• [GLUTEN-11849][CH] Fix diff for var_samp returns NaN instead of NULL when effective row count < 2 by @exmy in #11850
• [GLUTEN-11838] Enable 'Eliminate two aggregate joins with attribute reordered' suite by @zzcclp in #11884
• [GLUTEN-8821][VL] Weekly Update Velox function support docs (2026_04_06) by @GlutenPerfBot in #11881
• [MINOR] Remove Spark 3.2 tests by @philo-he in #11887
• [GLUTEN-11888] [VL] Remove the synchronized lock in VeloxBroadcastBuildSideCache by @JkSelf in #11834
• [GLUTEN-11888] [VL] Parallel build hash table to improve bhj performance by @JkSelf in #11889
• [VL] Remove metrics try-catch, fix Generate metrics, and handle missing join/aggregation params by @acvictor in #11861
• [CORE][UI] Fix fallback info for V2 writes and align plan with Spark SQL tab by @Zouxxyy in #11853
• [CH][VL] Move DateFormatter and TimestampFormatter creation out of partition value loops by @acvictor in #11843
• [GLUTEN-11673][CORE] Fix URL-encoded paths in ResourceUtil causing JAR loading failures by @clee704 in #11672
• [GLUTEN-11550][UT] Add GlutenTestSetWithSystemPropertyTrait, enable 6 suites, remove 7 TestHiveSingleton suites, fix JobTagging flaky test by @baibaichen in #11847
• [GLUTEN-10948][VL] Enable get_json_object UT by @zhouyuan in #11902
• [GLUTEN-11550][UT] Fix 2 TPCDS traits, enable 8 disabled test suites for Spark 4.x by @baibaichen in #11816
• [GLUTEN-11715][VL] Add fallback mirrors for libelf downloads by @officialasishkumar in #11904
• [GLUTEN-6887][VL] Daily Update Velox Version (2026_04_08) by @GlutenPerfBot in #11891
• [CORE] Move ClickHouse-only extended rule configs from GlutenConfig to CHConfig by @zml1206 in #11897
• [GLUTEN-11622][VL] Adds missing validation tests for timestamp related functions by @Mariamalmesfer in #11890
• [VL] Enable enhanced tests for spark 4.0 & fix failures by @infvg in #11868
• [GLUTEN-6887][VL] Daily Update Velox Version (2026_04_13) by @GlutenPerfBot in #11930
• [CPP] Format cpp code by @rui-mo in #11932
• [VL] Optimize bhj hash table built performance by @JkSelf in #11927
• [MINOR] Refactor: move ClickHouse-specific extension tests to backend module by @philo-he in #11926
• [CORE] Refactor common expression mappings out of Spark shims by @zml1206 in #11941
• [MINOR][DOCS] Fix several nit issues in docs by @anshulbaliga7 in #11936
• [VL] Find the aggregate function name by matching result type by @rui-mo in #11931
• [GLUTEN-6887][VL] Daily Update Velox Version (2026_04_15) by @GlutenPerfBot in #11945
• [GLUTEN-10215][VL] Delta 4 UT: add test infra synced from Delta 3.3 by @malinjawi in #11938
• [VL] Delta: Unify code style with Gluten codebase by @zhztheplayer in #11596
• [GLUTEN-11906][VL] Support dynamic build for ppc64le by @Jenkins-J in #11907
• Bump pillow from 12.1.1 to 12.2.0 in /tools/workload/benchmark_velox/analysis by @dependabot[bot] in #11940
• [VL][UT] Enable two tests previously failing due to Velox Expand operator bug by @philo-he in #11947
• [VL] Ignore null values when copy velox string buffer to arrow by @wankunde in #11944
• [GLUTEN-9456][VL] Override clone in GlutenDirectBufferedInput by @rui-mo in #11933
• [GLUTEN-11862][VL] Work around GMT session timezone validation failure on macOS by @malinjawi in #11869
• [GLUTEN-6887][VL] Daily Update Velox Version (2026_04_16) by @GlutenPerfBot in #11949
• [MINOR] Split Iceberg test resources into separate Maven entries by @zml1206 in #11952
• [VL] Fix shallow CreateNamedStruct detection in CollapseProjectExecTransformer by @acvictor in #11953
• [VL] shuffle: TypeAwareCompress(tac) for column-wise data compression like (U)INT64 by @guowangy in #11894
• [MINOR][DOCS] Fix typos in VeloxConfig.scala doc strings by @anshulbaliga7 in #11950
• [CORE] Add .claude/ to .gitignore by @baibaichen in #11962
• [VL] Add storageReads metric to track number of storage read operations by @FelixYBW in #11964
• [MINOR] Rename Spark resource and dependency installation scripts by @Yao-MR in #11937
• [GLUTEN-11958] Flatten pom for modules containing spark-shim by @wecharyu in #11959
• [VL] Experimental eager aggregation by @zhztheplayer in #11942
• [GLUTEN-6887][VL] Daily Update Velox Version (2026_04_17) by @GlutenPerfBot in #11956
• [GLUTEN-11895][VL] Fix SIGSEGV on IOThreadPool threads during HDFS scan by @guowangy in #11896
• [MINOR][VL] Fix install-spark-resources.sh: Spark 4.1 case references wrong directory (#11973) by @baibaichen in #11973
• [VL] Remove unused libprotobuf.so.32 from shared library loaders and build script by @liujiayi771 in #11974
• [CH] Fix package script issue by @zzcclp in #11886
• [GLUTEN-10134][VL] Add ANSI mode CI baseline with expression offload tracking by @baibaichen in #11975
• [GLUTEN-6887][VL] Daily Update Velox Version (2026_04_23) by @GlutenPerfBot in #11979
• [GLUTEN-10215][VL] Follow-up - Remove throw statement for FetchFailedException by @felipepessoto in #11978
• [GLUTEN-11969] Enable Java 17 release flag for Spark 4+ build by @Yao-MR in #11971
• [GLUTEN-10215][VL] Delta 4 native write support for Spark 4.0 by @malinjawi in #11924
• [VL] Move glog initialization before first LOG() call in VeloxBackend::init by @acvictor in #11983
• [GLUTEN-6887][VL] Daily Update Velox Version (2026_04_24) by @GlutenPerfBot in #11982
• [VL] Support case-insensitive celeborn shuffle manager detection by @kerwin-zk in #11992
• [INFRA] Upgrade scalafmt to 3.10.1 by @zml1206 in #11999
• [GLUTEN-11488][CH] Update Clickhouse Version (Stable-25.12.10.7_20260425) by @zzcclp in #11734
• [GLUTEN-11911][VL][Spark4] Enable Structured Streaming suites with GlutenPlugin fallback by @malinjawi in #11957
• [GLUTEN-12010][CH] Pass the correct values to ParquetInputFormat by @zzcclp in #12011
• [GLUTEN-11635][FOLLOW-UP] Respect partial fallback configs when checking node support by @wecharyu in #11988
• [VL][DELTA] Reconcile struct field names in CaseWhen/If for Velox SWITCH compatibility by @acvictor in #11948
• [VL] Added iceberg write configs by @infvg in #11776
• [GLUTEN-6887][VL] Daily Update Velox Version (2026_04_30) by @zhztheplayer in #12014
• [VL] Fix nightly upload action by @zhouyuan in #12006
• [DOC] Update Velox Delta guide for Spark 4.0 / Delta 4.0 support by @malinjawi in #12003
• [CORE] Upgrade Paimon to 1.4.1 by @Zouxxyy in #11996
• [GLUTEN-8304][CORE] Fix CollapseGetJsonObjectExpressionRule incorrectly merging paths across non-GJO expressions by @liujiayi771 in #12007
• [VL] Rework option spark.gluten.sql.columnar.backend.velox.asyncTimeoutOnTaskStopping by @zhztheplayer in #11882
• [GLUTEN-11885][VL] Respect custom VELOX_HOME in build info generation by @officialasishkumar in #11905
• [GLUTEN-12018] Support parquet metadata cache for the Parquet Reader V3 by @zzcclp in #12019
• [VL][CI] Fix clang-tidy CI failure by @raushanprabhakar1 in #12021
• [CI] Correct job names to align with tested Spark versions by @Zouxxyy in #11994
• [GLUTEN-12032][CH] Reopen some queries test for the Spark 3.5 by @zzcclp in #12033
• [MINOR] Add Hadoop 3.4 profile by @Zouxxyy in #11995
• [GLUTEN-12034][VL] Fix str_to_map MAP_KEY_DEDUP_POLICY comparison for Spark 4.1 compatibility by @surendralilhore in #12035
• [CORE][UI] Skip GlutenPlanFallbackEvent posting when gluten is disabled by @liujiayi771 in #12027
• [GLUTEN-6887][VL] Daily Update Velox Version (2026_05_02) by @GlutenPerfBot in #12023
• [VL][Delta] Add roaring bitmap facilities for Delta DV support by @malinjawi in #12001
• [MINOR][VL] Improve validation log messages for aggregate function signature binding by @philo-he in #12031
• [MINOR] Ignore .idea/vcs.xml from git tracking by @infvg in #12041
• [GLUTEN-12044][CH] Fix build on arm by @zhanglistar in #12046
• [GLUTEN-1433][VL][FOLLOWUP] Fix TimestampNTZ schema validation never matching due to Scala object simpleName suffix by @liujiayi771 in #12029
• [GLUTEN-6887][VL] Daily Update Velox Version (2026_05_06) by @GlutenPerfBot in #12043
• [GLUTEN-11920][CORE] Keep columnar children for dual-mode parents with row output by @Yao-MR in #12004
• [GLUTEN-11918][VL] Fall back Cast when per-expression timezone differs from session timezone by @Yao-MR in #12048
• [VL][Delta] Offload Delta OPTIMIZE compaction command transactions by @malinjawi in #12024
• [VL][MINOR] Remove unused bloom filter configs by @acvictor in #12002
• [VL] Fix json_tuple rewrite producing incompatible JSON path in fallback scenarios by @Zouxxyy in #12038
• [CORE] Preserve fallback tag for nodes without logicalLink in RemoveFallbackTagRule by @liujiayi771 in #12028
• [GLUTEN-12053][CELEBORN] Bump Celeborn version to 0.6.3 by @SteNicholas in #12057
• Bump gitpython from 3.1.43 to 3.1.47 in /tools/workload/benchmark_velox/analysis by @dependabot[bot] in #12037
• [GLUTEN-11782][CORE] Optimize parquet metadata validation by sampling by @Yao-MR in #12042
• [CORE] Deduplicate fallback reason when merging Appendable tags by @liujiayi771 in #12049
• [VL] Fix parallel BHJ build after #11882 by @zhztheplayer in #12070
• [GLUTEN-6887][VL] Daily Update Velox Version (2026_05_11) by @GlutenPerfBot in #12068
• [GLUTEN-12075][CH] Add a metric to indicate whether it is Parquet Reader V3 for the CH Backend by @zzcclp in #12076
• [MINOR][DOC] Add AGENTS.md with guidelines for AI coding agents by @nookcreed in #12081
• [GLUTEN-6887][VL] Daily Update Velox Version (2026_05_13) by @GlutenPerfBot in #12085
• [GLUTEN-11867] Add JDK 25 build support by @Yao-MR in #12012
• [VL] Fix SCOPED_TIMER macro destroying timer immediately by @luis4a0 in #12083
• [GLUTEN-12071][VL] Respect HadoopConf write options in Velox native Parquet writer by @wecharyu in #12072
• Bump mistune from 3.0.2 to 3.2.1 in /tools/workload/benchmark_velox/analysis by @dependabot[bot] in #12093
• [GLUTEN-10072][UT] Enable hive execution tests by @wecharyu in #12005
• [GLUTEN-6887][VL] Daily Update Velox Version (2026_05_15) by @GlutenPerfBot in #12096
• [VL] Add min/max partition stats to columnar InMemoryRelation cache for partition pruning by @yaooqinn in #12092
• [VL] Restore hash shuffle reader payload merging by @zhli1142015 in #12097
• [VL] Add per-batch input-encoding counter to VeloxHashShuffleWriter by @luis4a0 in #12107
• [CORE] Fix Delta 4.0 Spark 4.1 package build by @malinjawi in #12078
• [VL] Reduce Velox hash shuffle partition buffer memory by evicting large partitions after split by @wankunde in #12089
• [VL] Add Velox batch resizer copyRanges fast path by @zhli1142015 in #12101
• [VL] Fix silent stats prune for non-binary collation StringType in cache by @yaooqinn in #12112
• [MINOR][DOC] Fix and expand build/test instructions in AGENTS.md by @yaooqinn in #12121
• [VL] Add cross-config / cross-build-cycle invariant tests for ColumnarCachedBatchSerializer by @yaooqinn in #12124
• [GLUTEN-6887][VL] Daily Update Velox Version (2026_05_18) by @GlutenPerfBot in #12102
• [VL] Delta: Add native Delta DV reader support by @malinjawi in #12040
• [GLUTEN-11998][CORE] Fix incorrect modifiability status for GlutenConfig entries by @malinjawi in #12036
• [GLUTEN-6887][VL] Daily Update Velox Version (2026_05_22) by @GlutenPerfBot in #12128
• [GLUTEN-11991][VL] CI: Switch to gcc 13 images by @zhztheplayer in #12118
• [MINOR][VL] Remove dead Arrow-CSV / Arrow-Dataset JVM code paths by @yaooqinn in #12130
• [VL] Add metric abandonedPartialAggregation by @zhztheplayer in #12106
• [BUILD] Upgrade Maven to 3.9.16 by @Yao-MR in #12059
• [GLUTEN-6887][VL] Daily Update Velox Version (2026_05_25) by @GlutenPerfBot in #12133
• Bump org.apache.flink:flink-table-planner_2.12 from 1.16.2 to 1.20.4 in /backends-clickhouse by @dependabot[bot] in #12134
• [VL] Add devcontainer configuration for Gluten Velox Backend by @felipepessoto in #12125
• [Velox][Build][MIRROR] Skip sudo on macOS when staging Velox Arrow patches by @jackylee-ch in #12129
• [GLUTEN-3456][VL] Enable columnar table cache by default and extend benchmark coverage by @yaooqinn in #12138
• Bump lxml from 5.2.2 to 6.1.0 in /tools/workload/benchmark_velox/analysis by @dependabot[bot] in #12139
• Bump gitpython from 3.1.47 to 3.1.50 in /tools/workload/benchmark_velox/analysis by @dependabot[bot] in #12140
• [MINOR][TEST] Remove SparkFunctionStatistics by @philo-he in #12136
• [MINOR][GLUTEN-12137] Remove gluten-te folder by @philo-he in #12149
• [VL] Narrow down FlushableHashAggregateRule to only protect against Spark code AggUtils.planAggregateWithOneDistinct by @zhztheplayer in #12098
• [GLUTEN-6887][VL] Daily Update Velox Version (2026_05_27) by @GlutenPerfBot in #12150
• Bump pip from 26.0 to 26.1 in /tools/workload/benchmark_velox/analysis by @dependabot[bot] in #12144
• Bump nbconvert from 7.17.0 to 7.17.1 in /tools/workload/benchmark_velox/analysis by @dependabot[bot] in #12145
• [GLUTEN-12058][VL][MINOR] Skip stage ResourceProfile adjustment rule when off-heap memory is disabled by @wForget in #12060
• [VL] Fix false-EOF probe in ColumnarCachedBatchSerializer.read trailing markers by @yaooqinn in #12147
• [MINOR][DOC] Update default of spark.gluten.sql.columnar.tableCache to true by @yaooqinn in #12153
• [GLUTEN-8232][VL] Allow to enable dynamic openssl link in VCPKG packaging by @zhouyuan in #11444
• [VL][FOLLOWUP] Reduce Velox hash shuffle partition buffer memory by evicting large partitions after split by @wankunde in #12156
• [VL] Hoist per-partition constants out of ColumnarCachedBatchSerializer.serialize hot path by @yaooqinn in #12166
• [VL] Fix Iceberg writer aggregate-init build failure on macOS C++20 libc++ by @jackylee-ch in #12115
• [GLUTEN-11917][VL] Respect allowPrecisionLoss from expression context in Spark 4.1 by @nookcreed in #12110
• [INFRA] Use hadoop 2.10.2 for uniffle test by @wecharyu in #12111
• [GLUTEN-6887][VL] Daily Update Velox Version (2026_05_28) by @GlutenPerfBot in #12162
• Bump pyopenssl from 21.0.0 to 26.0.0 in /tools/workload/benchmark_velox/analysis by @dependabot[bot] in #12159
• Bump idna from 3.10 to 3.15 in /tools/workload/benchmark_velox/analysis by @dependabot[bot] in #12167
• [VL] Compute real nullCount for flat-encoded unsupported types in cached-batch partition stats by @yaooqinn in #12176
• [GLUTEN-11980][CORE][TESTS] Add test cases for decimal-key file type and read type different by @beliefer in #12061
• [GLUTEN-12181][CH] Fix issues for the Spark 3.5 + Delta Delete Vector with the CH backend by @zzcclp in #12182
• [VL] Bump Iceberg/Hudi for Spark-4.1 package by @zhouyuan in #12168
• [VL] Catch corrupt stats frames per-batch in ColumnarCachedBatchSerializer by @yaooqinn in #12183
• [GLUTEN-12185][CH] Guard missing prepared set in parquet index filter by @lgbo-ustc in #12186
• [GLUTEN-12172][CH] Fix group limit first array result offset by @lgbo-ustc in #12173
• [GLUTEN-12169][CH] Fix str_to_map nullable input null-map access by @lgbo-ustc in #12170
• [GLUTEN-12174][CH] Fix flatten nullable inner array row handling by @lgbo-ustc in #12175
• [VL] Simplify the logic in AppendBatchResizeForShuffleInputAndOutput by @marin-ma in #12087
• [GLUTEN-6887][VL] Daily Update Velox Version (2026_05_29) by @GlutenPerfBot in #12189
• [VL][TEST] Pin framedSerializeWithStats cross-language wire format by @yaooqinn in #12196
• [MINOR] Make ci-velox-buildstatic-centos-9.sh executable by @felipepessoto in #12200
• [GLUTEN-8232][VL] Followup to update doc for VCPKG dynamic openssl feature by @zhouyuan in #12178
• [VL] Tighten cache-stats wire-edge bound checks by @yaooqinn in #12224
• [VL] Isolate /usr/local from native builds on macOS by @jackylee-ch in #12105
• [VL][Delta] Add DV scan info extraction utility by @malinjawi in #12197
• [GLUTEN-6887][VL] Daily Update Velox Version (2026_06_02) by @GlutenPerfBot in #12223
• [INFRA] Enable automated GitHub Copilot code reviews by @zhouyuan in #12228
• [VL] Skip escape argument when offloading Like expressions without backslashes by @zhulipeng in #12152
• [VL] Support native scala udaf in window by @marin-ma in #12117
• [GLUTEN-12225][CORE] Fix arrow.c shading: exclude memory/vector packages so public API stays unshaded by @sezruby in #12226
• [GLUTEN-12143][VL] Route bitmap_construct_agg to native Velox execution by @minni31 in #12142
• [MINOR] Upgrade Spark 4.0 to 4.0.2 by @yaooqinn in #12180
• [GLUTEN-6887][VL] Daily Update Velox Version (2026_06_04) by @GlutenPerfBot in #12230
• [GLUTEN-12022][VL] Extend S3 filesystem registration in Gluten by @ReemaAlzaid in #12026
• [VL] Reduce Velox scan SQL metrics by default to mitigate driver OOM by @lifulong in #12127
• [VL] Bump FasterXML Jackson to 2.18.6 for Spark 3.5 and above by @zhouyuan in #12243
• [MINOR] Fix typo in shuffleInputOutput config name by @Xtpacz in #12239
• [VL] Fixed iceberg table properties config logic by @infvg in #12221
• [GLUTEN-6887][VL] Daily Update Velox Version (2026_06_05) by @GlutenPerfBot in #12247
• [GLUTEN-10215][VL] Remove streaming aggregation workaround in Delta stats writer by @zhztheplayer in #12222
• [VL] Respect orc.force.positional.evolution by @beliefer in #12234
• [MINOR][VL] Re-enable stale ignored atan2 test in MathFunctionsValidateSuite by @brijrajk in #12199
• Bump pyarrow from 16.1.0 to 23.0.1 in /tools/workload/benchmark_velox/analysis by @dependabot[bot] in #12254
• [Core] Upgrade default spark version to 4.0.2 by @zhouyuan in #12252
• [VL] Make Velox memory manager capacity ratio configurable by @pratham76 in #12258
• [MINOR][VL] Drop modify_arrow_dataset_scan_option.patch by @yaooqinn in #12148
• [GLUTEN-11915][VL] Support RowBasedChecksum in ColumnarShuffleWriter (SPARK-51756) by @jaylisde in #12067
• [GLUTEN-12193] Support Rocky Linux and AlmaLinux 9 in Velox build setup(#12193) by @senthh in #12194
• [GLUTEN-10511][VL][Delta] Fix wrong result with partition filters under column mapping by @sezruby in #12240
• [VL] Fix gflags mode in folly on Centos9 by @zhouyuan in #12265
• [GLUTEN-12235][VL] Fix hash shuffle spill ordering when evicting partition buffers by @zml1206 in #12231
• [MINOR] Refactor operator-enable configs and remove dead code by @philo-he in #12212
• [CORE] Drop 15.0.0-gluten Arrow version rename and depend on vanilla Apache Arrow by @sezruby in #12244
• [GLUTEN-10246][FLINK] Support processing time window(tumble) for nextmark q12 by @KevinyhZou in #10898
• [GLUTEN-6887][VL] Daily Update Velox Version (2026_06_06) by @rui-mo in #12270
• Update Apache Gluten logo by @malinjawi in #12268
• [CORE] Optimize Iceberg schema field matching by @wankunde in #12275
• [GLUTEN-11622][VL] Add basic TIMESTAMP_NTZ type support (#11939) by @rui-mo in #12229
• [CORE] Fix UnsupportedOperationException in input_file_name() with broadcast join build-side LocalRelation by @taiyang-li in #12272
• [VL] Fix GH action cache reuse for GPU build by @zhouyuan in #12285
• [VL][Delta] Add JVM Delta DV scan handoff by @malinjawi in #12269
• [VL] Fix segfault on thread pool destruction by @marin-ma in #12286
• [VL] Re-enable some decimal tests by @zhztheplayer in #12287
• [VL] Support lead, lag and nth_value offloading with constant input by @philo-he in #12308
• [GLUTEN-12251][VL] Support merging broadcast batches for BHJ performance by @Xtpacz in #12259
• Introduce config to allow fail on fallback by @felixloesing in #12279
• [VL][Delta] Add native Delta bitmap aggregation support by @malinjawi in #12214
• [VL] Use Velox TaskCursor infrastructure by @zhztheplayer in #12302
• [GLUTEN-12313][VL] Update docker build related actions to meet apache requirements by @zhouyuan in #12314
• [GLUTEN-12282][VL] Check JoinRel's post-join filter in native validation by @Xtpacz in #12315
• [VL] Enable hour(timestamp_ntz) native execution in Velox backend by @Mariamalmesfer in #12064
• [GLUTEN-6887][VL] Daily Update Velox Version (2026_06_12) by @GlutenPerfBot in #12281
• [VL] Update for CI image build with recent workaround by @zhouyuan in #12322
• [VL][branch-1.7] Backport: Throws user error for invalid index in the nested field reference into array/map (#12290) by @felipepessoto in #12337
• [VL][branch-1.7] Update Velox branch by @philo-he in #12361
• [VL][branch-1.7] Backport: Fix build issues reported by weekly jobs (#12321) by @philo-he in #12600
• Backport two commits to branch 1.7 by @philo-he in #12706
• [VL][DOC] Update Velox backend limitations (#12575) by @philo-he in #12707
• [1.7] Update release document and script by @philo-he in #12733
• [1.7] Set version to 1.7.0 by @philo-he in #12732
• [MINOR] Add missing ASF license headers by @weiting-chen in #12767
• [MINOR][VL] Avoid bundling Linux UAPI socket header (#12768) by @philo-he in #12786
• [1.7] Exclude Git-specific files from source release archive by @philo-he in #12787
• [1.7][VL] Use Velox tags for Gluten 1.7.0 by @philo-he in #12788

New Contributors

• @satyakommula96 made their first contribution in #11610
• @sh-shamsan made their first contribution in #11721
• @officialasishkumar made their first contribution in #11904
• @anshulbaliga7 made their first contribution in #11936
• @guowangy made their first contribution in #11894
• @Yao-MR made their first contribution in #11937
• @raushanprabhakar1 made their first contribution in #12021
• @surendralilhore made their first contribution in #12035
• @nookcreed made their first contribution in #12081
• @luis4a0 made their first contribution in #12083
• @zhulipeng made their first contribution in #12152
• @sezruby made their first contribution in #12226
• @minni31 made their first contribution in #12142
• @jaylisde made their first contribution in #12067
• @senthh made their first contribution in #12194

Full Changelog: v1.6.0...v1.7.0-rc1