-
Notifications
You must be signed in to change notification settings - Fork 28.8k
Pull requests: apache/spark
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
[SPARK-53499][PYTHON] from_arrow_type should respect containsNull in ArrayType
PYTHON
SQL
#52243
opened Sep 5, 2025 by
zhengruifeng
Loading…
[SPARK-53402][CONNECT] Support Direct Passthrough Partitioning Dataset API in Spark Connect
CONNECT
SQL
#52242
opened Sep 4, 2025 by
shujingyang-db
•
Draft
[SPARK-53497][PS] Disallow
/
|//
|*
between Decimal and float under ANSI
PANDAS API ON SPARK
PYTHON
#52241
opened Sep 4, 2025 by
xinrong-meng
Loading…
[SPARK-53491][SS] Fix exponential formatting of inputRowsPerSecond and processedRowsPerSecond in progress metrics JSON
SQL
STRUCTURED STREAMING
#52237
opened Sep 4, 2025 by
jayantdb
Loading…
[SPARK-53490][CONNECT][SQL] Fix Protobuf conversion in observed metrics
CONNECT
SQL
#52236
opened Sep 4, 2025 by
heyihong
Loading…
[SPARK-53489] Remove using
v2ColumnsToStructType
in ApplyDefaultCollationToStringType
SQL
#52234
opened Sep 4, 2025 by
ilicmarkodb
Loading…
[SPARK-53488][SQL] Update CollationTypeCoercion to be compatible with single-pass Analyzer logic
SQL
#52233
opened Sep 4, 2025 by
vladimirg-db
Loading…
[SPARK-53492][CONNECT] Reject second ExecutePlan with an operation id that has already completed
CONNECT
SQL
#52232
opened Sep 4, 2025 by
nija-at
Loading…
[SPARK-53486][ML][PYTHON] Avoid setting
weights_only=False
in torch model load
CONNECT
ML
PYTHON
#52231
opened Sep 4, 2025 by
zhengruifeng
Loading…
made changes to readme file talked about feature1
DOCS
#52230
opened Sep 4, 2025 by
banaluhemanth-hub
Loading…
[WIP][SPARK-52348][SDP] Trait for PipelinesHandler
CONNECT
SQL
#52228
opened Sep 4, 2025 by
JiaqiWang18
Loading…
[SPARK-53483][SQL] Support disable code-gen for sort merge join other than FULL OUTER and Existence
SQL
#52227
opened Sep 4, 2025 by
zml1206
Loading…
[SPARK-53482][SQL] MERGE INTO support nested case where source has less fields than target
SQL
#52225
opened Sep 4, 2025 by
szehon-ho
Loading…
[SPARK-53479][PS] Align
==
behavior with pandas when comparing against scalar under ANSI
PANDAS API ON SPARK
PYTHON
#52224
opened Sep 3, 2025 by
xinrong-meng
Loading…
[SPARK-53474][SQL] Add conf DATA_SOURCE_V2_EXPR_FOLDING
SQL
#52222
opened Sep 3, 2025 by
yhuang-db
Loading…
[SPARK-53480][PYTHON] Refactor arrow python runner code
PYTHON
SQL
#52214
opened Sep 3, 2025 by
richardc-db
Loading…
[SPARK-53469][SQL] Ability to cleanup shuffle in Thrift server
SQL
#52213
opened Sep 3, 2025 by
karuppayya
Loading…
[SPARK-53481][PYTHON] Make Hybrid queue class
PYTHON
SQL
STRUCTURED STREAMING
#52212
opened Sep 3, 2025 by
richardc-db
Loading…
[SPARK-53446][CORE] Optimize BlockManager remove operations with cached block mappings
CORE
#52210
opened Sep 3, 2025 by
JacobZheng0927
Loading…
[SPARK-XXXX] Rocks db state store orphan removal protection
SQL
STRUCTURED STREAMING
#52209
opened Sep 3, 2025 by
PedroMDuarte
Loading…
[SPARK-53332][SS] Enable StateDataSource with state checkpoint v2 (only snapshotStartBatchId option)
PYTHON
SQL
STRUCTURED STREAMING
#52202
opened Sep 2, 2025 by
dylanwong250
Loading…
[SPARK-53458][INFRA] Add daily dry-run release test GitHub Action jobs for Spark 4.0/3.5
INFRA
#52201
opened Sep 2, 2025 by
dongjoon-hyun
•
Draft
Previous Next
ProTip!
Filter pull requests by the default branch with base:master.