1 Pull request merged by 1 person

• [Core]Convert shuffleWriteTime from Nanoseconds to Milliseconds for Consistency with Other Metrics

  #50400 merged Mar 26, 2025

23 Pull requests opened by 18 people

• [MINOR][DOCS]: corrected spellings and typos

  #50376 opened Mar 24, 2025

• [SPARK-46860][CORE]Enable basic authentication when downloading jars and other files from secured repos

  #50377 opened Mar 24, 2025

• [SPARK-51596][SS] Fix concurrent StateStoreProvider maintenance and closing

  #50391 opened Mar 25, 2025

• [SPARK-51615][SQL] Refactor ShowNamespaces to use RunnableCommand

  #50393 opened Mar 25, 2025

• [WIP] StateStore state machine

  #50394 opened Mar 26, 2025

• [SPARK-51603][CONNECT][TESTS] Auto ignore tests that require starting `SparkConnectServer` when the directory `assembly/target/scala-2.13/jars/` not exist

  #50396 opened Mar 26, 2025

• [Spark-50873][SQL] Prune column after RewriteSubquery rule for DSV2

  #50399 opened Mar 26, 2025

• [SPARK-51609][SQL] Optimize Recursive CTE execution for simple queries

  #50402 opened Mar 26, 2025

• [SPARK-51252][SS][TESTS] Make tests more consistent for StateStoreInstanceMetricSuite

  #50405 opened Mar 26, 2025

• [SPARK-51611][SQL] New iteration of single-pass Analyzer functionality

  #50406 opened Mar 26, 2025

• [SPARK-51439][SQL] Support SQL UDF with DEFAULT argument

  #50408 opened Mar 26, 2025

• [SPARK-51614] [SQL] Introduce ResolveUnresolvedHaving rule in the Analyzer

  #50409 opened Mar 26, 2025

• [SPARK-51616][SQL] Run CollationTypeCasts before ResolveAliases and ResolveAggregateFunctions

  #50410 opened Mar 26, 2025

• Report metrics for failed writes for V2 data sources

  #50413 opened Mar 26, 2025

• [SPARK-51637][PYTHON] Implement createColumnarReader for Python Data Source

  #50414 opened Mar 26, 2025

• [SPARK-51619][PYTHON] Support UDT input / output in Arrow-optimized Python UDF

  #50417 opened Mar 27, 2025

• [Core]Convert shuffleWriteTime from Nanoseconds to Milliseconds for Consistency with Other Metrics

  #50418 opened Mar 27, 2025

• [MINOR][FOLLOW-UP][SPARK-51612][SQL]Update Desc As JSON test to use withSQLConf

  #50419 opened Mar 27, 2025

• [WIP][INFRA] Add a job to guide spark shell

  #50423 opened Mar 27, 2025

• [SPARK-51629][UI] Add a download link on the ExecutionPage for svg/dot/txt format plans

  #50427 opened Mar 27, 2025

• [SPARK-51632][INFRA] Passing Command Line Arguments of lint-js to eslint

  #50430 opened Mar 27, 2025

• [SPARK-50657][DOCS][FOLLOW-UP] Fix the recommended pyarrow version

  #50432 opened Mar 27, 2025

• [SPARK-51641][SQL] Fixed CREATE OR REPLACE TABLE ... DEFAULT COLLATION and views with default collation

  #50434 opened Mar 27, 2025

22 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• [SPARK-51358] [SS] Introduce snapshot upload lag detection through StateStoreCoordinator

  #50123 commented on Mar 27, 2025 • 14 new comments

• [SPARK-51566][PYTHON] Python UDF traceback improvement

  #50313 commented on Mar 27, 2025 • 9 new comments

• [SPARK-51592][SQL] Avoid logging makes Driver OOM in AdaptiveSparkPlanExec

  #50368 commented on Mar 27, 2025 • 3 new comments

• [SPARK-51537][CONNECT][CORE] construct the session-specific classloader based on the default session classloader on executor

  #50334 commented on Mar 27, 2025 • 2 new comments

• [SPARK-51338][INFRA] Add automated CI build for `connect-examples`

  #50187 commented on Mar 27, 2025 • 2 new comments

• [SPARK-51513][SQL] Fix RewriteMergeIntoTable rule produces unresolved plan

  #50281 commented on Mar 25, 2025 • 1 new comment

• [SPARK-51191][SQL] Validate default values handling in DELETE, UPDATE, MERGE

  #50271 commented on Mar 27, 2025 • 1 new comment

• [SPARK-51270] Support nanosecond precision timestamp in Variant

  #50270 commented on Mar 27, 2025 • 1 new comment

• [WIP][SPARK-24815] [CORE] Trigger Interval based DRA for Structured Streaming

  #42352 commented on Mar 27, 2025 • 0 new comments

• [SPARK-51062][PYTHON] Fix assertSchemaEqual to compare decimal precision and scale

  #50365 commented on Mar 27, 2025 • 0 new comments

• [SPARK-47193][SQL] Ensure SQL conf is propagated to executors when actions are called on RDD returned by `Dataset#rdd`

  #48325 commented on Mar 27, 2025 • 0 new comments

• [SPARK-49953][CORE] Require `errorClass` in `SparkException`

  #48440 commented on Mar 27, 2025 • 0 new comments

• [SPARK-51414][SQL] Add the make_time() function

  #50269 commented on Mar 25, 2025 • 0 new comments

• [SPARK-51318][TESTS] Remove `jar` files from Apache Spark repository and disable affected tests

  #50231 commented on Mar 27, 2025 • 0 new comments

• [WIP][SPARK-51348][BUILD][SQL] Upgrade Hive to 4.0

  #50213 commented on Mar 26, 2025 • 0 new comments

• [CORE][SPARK-49788] Add optional TTL based cleaning for blocks to better support notebooks

  #49032 commented on Mar 27, 2025 • 0 new comments

• [WIP][SPARK-44662][SQL] Perf improvement in BroadcastHashJoin queries with stream side join key on non partition columns

  #49209 commented on Mar 26, 2025 • 0 new comments

• [SPARK-44856][PYTHON] Improve Python UDTF arrow serializer performance

  #50099 commented on Mar 27, 2025 • 0 new comments

• [SPARK-51298][SQL] Support variant in CSV scan

  #50052 commented on Mar 24, 2025 • 0 new comments

• [SPARK-51264][SQL][JDBC] JDBC write keeps driver connection open unnecessarily

  #50014 commented on Mar 27, 2025 • 0 new comments

• [SPARK-51608] Log exception on Python runner termination

  #49890 commented on Mar 26, 2025 • 0 new comments

• [SPARK-50992][SQL] OOMs and performance issues with AQE in large plans

  #49724 commented on Mar 27, 2025 • 0 new comments