Commits

Branch selector

 master

User selector

All users

Datepicker

All time

Commit History

Commits on Apr 26, 2025

• [SPARK-51904][SS] Removing async metadata purging for StateSchemaV3 and ignoring non-batch files when listing OperatorMetadata files

  Show description for 23785d3
  

  ericm-db

  authored and

  HeartSaVioR

  committed
  23785d3

  Copy full SHA for 23785d3

Commits on Apr 25, 2025

• [SPARK-51900][SQL] Properly throw datatype mismatch in single-pass Analyzer

  Show description for c2305ed
  

  vladimirg-db

  authored and

  MaxGekk

  committed
  c2305ed

  Copy full SHA for c2305ed

• [SPARK-51805][SQL] Get function with improper argument should throw proper exception instead of an internal one

  Show description for 1c1d80f
  

  mihailoale-db

  authored and

  cloud-fan

  committed
  1c1d80f

  Copy full SHA for 1c1d80f

• [SPARK-51915][PYTHON][CONNECT][TESTS] Enable SparkConnectDataFrameDebug in connect-only mode

  Show description for 676cac0
  zhengruifeng

  committed
  676cac0

  Copy full SHA for 676cac0

• [MINOR][PYTHON][DOCS] Add 4 missing functions to API references

  Show description for e3d0c0f
  zhengruifeng

  committed
  e3d0c0f

  Copy full SHA for e3d0c0f

• [SPARK-51909][INFRA][FOLLOW-UP] Fix python lint

  Show description for 80ed987
  zhengruifeng

  committed
  80ed987

  Copy full SHA for 80ed987

• [SPARK-51908][K8S][TESTS] Update `setup-minikube` to v0.0.19

  Show description for 72d11ea
  dongjoon-hyun

  committed
  72d11ea

  Copy full SHA for 72d11ea

• [SPARK-51896][CORE][SQL] Add Java Enum Support for TypedConfigBuilder

  Show description for 8c808af
  yaooqinn

  committed
  8c808af

  Copy full SHA for 8c808af

• [SPARK-51878][SQL] Improve fillDefaultValue by exec the foldable default expression

  Show description for 98ba05e
  

  beliefer

  authored and

  cloud-fan

  committed
  98ba05e

  Copy full SHA for 98ba05e

• [SPARK-51909][INFRA] Add a scheduled workflow for PySpark Classic-only

  Show description for 87cd48f
  zhengruifeng

  committed
  87cd48f

  Copy full SHA for 87cd48f

• [SPARK-51891][SS] Squeeze the protocol of ListState GET / PUT / APPENDLIST for transformWithState in PySpark

  Show description for 2c0fc70
  HeartSaVioR

  committed
  2c0fc70

  Copy full SHA for 2c0fc70

Commits on Apr 24, 2025

• [SPARK-51881][SQL] Make AvroOptions comparable

  Show description for 83db398
  

  vladimirg-db

  authored and

  HyukjinKwon

  committed
  83db398

  Copy full SHA for 83db398

• [SPARK-51897][SQL] Fix compilation warnings related to "The auto insertion will be deprecated, please write `TimeType.apply` explicitly"

  Show description for bab6988
  LuciferYang

  committed
  bab6988

  Copy full SHA for bab6988

• [SPARK-51898][PYTHON][CONNECT][TESTS] Refactor SparkConnectErrorTests to support connect-only mode

  Show description for 8da4904
  zhengruifeng

  committed
  8da4904

  Copy full SHA for 8da4904

• [SPARK-51895][K8S][INFRA] Update K8s IT CI to use K8s 1.33

  Show description for d2a3f88
  

  dongjoon-hyun

  authored and

  HyukjinKwon

  committed
  d2a3f88

  Copy full SHA for d2a3f88

• [MINOR][PYTHON][TESTS] Further fix scheduled builder without grpc

  Show description for bdc5232
  zhengruifeng

  committed
  bdc5232

  Copy full SHA for bdc5232

• [SPARK-51877][PYTHON][CONNECT] Add functions 'chr', 'random' and 'uuid'

  Show description for 5b7abdc
  zhengruifeng

  committed
  5b7abdc

  Copy full SHA for 5b7abdc

• [SPARK-51889][PYTHON][SS] Fix a bug for MapState clear() in Python TWS

  Show description for 6eb9668
  

  bogao007

  authored and

  HeartSaVioR

  committed
  6eb9668

  Copy full SHA for 6eb9668

• [SPARK-51874][CORE][SQL] Add TypedConfigBuilder for Scala Enumeration

  Show description for 5a5bf04
  yaooqinn

  committed
  5a5bf04

  Copy full SHA for 5a5bf04

• [SPARK-51119][SQL][FOLLOW-UP] Fix missing fallback case for parsing corrupt exists_default value

  Show description for 516859f
  

  szehon-ho

  authored and

  cloud-fan

  committed
  516859f

  Copy full SHA for 516859f

• [SPARK-51439][SQL] Support SQL UDF with DEFAULT argument

  Show description for 6df5cb7
  

  2 peopleauthored and

  cloud-fan

  committed
  6df5cb7

  Copy full SHA for 6df5cb7

Commits on Apr 23, 2025

• [SPARK-51865][CONNECT][TESTS] Print stacktrace message when `o.a.arrow.memory.BaseAllocator` fails to close

  Show description for ce7f335
  

  LuciferYang

  authored and

  cloud-fan

  committed
  ce7f335

  Copy full SHA for ce7f335

• [SPARK-51873][ML] For OneVsRest algorithm, allow using save / load to replace cache

  Show description for d9816b7
  WeichenXu123

  committed
  d9816b7

  Copy full SHA for d9816b7

• [SPARK-51820][SQL][FOLLOWUP] Fix `origin` for `UnresolvedOrdinal`

  Show description for 632e681
  

  mihailotim-db

  authored and

  cloud-fan

  committed
  632e681

  Copy full SHA for 632e681

• [SPARK-51868][SQL] Move type coercion validation to a separate object

  Show description for 920634a
  

  vladimirg-db

  authored and

  MaxGekk

  committed
  920634a

  Copy full SHA for 920634a

• [SPARK-51711][ML][PYTHON][CONNECT] Propagates the active remote spark session to new threads to fix CrossValidator

  Show description for a28977e
  

  xi-db

  authored and

  zhengruifeng

  committed
  a28977e

  Copy full SHA for a28977e

• [SPARK-51876][PYTHON][TESTS] Add configuration for `log4j.configurationFile` in the PySpark submission args of `run_individual_python_test`

  Show description for a9128a0
  LuciferYang

  committed
  a9128a0

  Copy full SHA for a9128a0

• [SPARK-47791][SQL][FOLLOWUP] Avoid invalid JDBC decimal scale

  Show description for 24511dd
  

  cloud-fan

  authored and

  yaooqinn

  committed
  24511dd

  Copy full SHA for 24511dd

• [SPARK-50582][PYTHON][FOLLOW-UP] Add `quote` to functions `__all__`

  Show description for 124a17f
  zhengruifeng

  committed
  124a17f

  Copy full SHA for 124a17f

• [SPARK-51866][CONNECT][TESTS] Ensure `serializerAllocator/deserializerAllocator` are closed if `ArrowEncoderSuite#roundTripWithDifferentIOEncoders` fails to create `CloseableIterator`

  Show description for d7ce6ef
  LuciferYang

  committed
  d7ce6ef

  Copy full SHA for d7ce6ef

• [SPARK-51856][ML][CONNECT] Update model size API to count distributed DataFrame size

  Show description for cdd5296
  WeichenXu123

  committed
  cdd5296

  Copy full SHA for cdd5296

Commits on Apr 22, 2025

• [SPARK-51822][SS] Throwing classified error when disallowed functions are called during StatefulProcessor.init()

  Show description for 772c4cb
  

  ericm-db

  authored and

  HeartSaVioR

  committed
  772c4cb

  Copy full SHA for 772c4cb

• [SPARK-51814][SS][PYTHON][FOLLLOW-UP] Uses `list(self)` instead of `StructType.fields` for old version compat

  Show description for 58adb01
  HyukjinKwon

  committed
  58adb01

  Copy full SHA for 58adb01

• [SPARK-51849][SQL] Refactoring `ResolveDDLCommandStringTypes`

  Show description for c86f617
  

  ilicmarkodb

  authored and

  cloud-fan

  committed
  c86f617

  Copy full SHA for c86f617

• [SPARK-51862][ML][CONNECT][TESTS] Clean up ml cache before ReusedConnectTestCase and ReusedMixedTestCase

  Show description for 3a7d5d7
  zhengruifeng

  committed
  3a7d5d7

  Copy full SHA for 3a7d5d7

Pagination

Previous

Next