Search results

[MINOR][DOCS] Updated the docstring of DataStreamWriter.foreach() method

AVRO

BUILD

CONNECT

CORE

DOCS

DSTREAM

INFRA

KUBERNETES

ML

PANDAS API ON SPARK

PYTHON

SQL

STRUCTURED STREAMING

WEB UI

YARN

Status: Open (in progress).

apache/sparknumber 51316

#51316 In apache/spark;

· nagaarjun-p opened on Jun 29, 2025

[SPARK-46912][CORE] Using correct environment variables on workers of StandAlone cluster

CORE

Status: Open (in progress).

apache/sparknumber 51314

#51314 In apache/spark;

· MeltonSmith opened on Jun 28, 2025

[WIP][PYTHON] Arrow UDF for aggregation

BUILD

CONNECT

CORE

PYTHON

SQL

Status: Draft (not ready).

apache/sparknumber 51292

#51292 In apache/spark;

· zhengruifeng opened on Jun 26, 2025

[SPARK-50686][SQL] Hash to sort aggregation fallback - memory usage optimization

CORE

SQL

Status: Open (in progress).

apache/sparknumber 51290

#51290 In apache/spark;

· akupchinskiy opened on Jun 26, 2025

[CORE] Let LocalSparkContext clear active context in beforeAll

CORE

Status: Open (in progress).

apache/sparknumber 51284

#51284 In apache/spark;

· price-qian opened on Jun 25, 2025

[DRAFT][PYTHON] Improve Python UDF Arrow Serializer Performance

CORE

DOCS

PYTHON

SQL

Status: Draft (not ready).

apache/sparknumber 51225

#51225 In apache/spark;

· asl3 opened on Jun 19, 2025

[SPARK-52507][CORE] Attempt to read missing block from fallback storage

CORE

Status: Open (in progress).

apache/sparknumber 51202

#51202 In apache/spark;

· EnricoMi opened on Jun 17, 2025

[SPARK-52506][CORE] Allow migrating to fallback storage only

CORE

Status: Open (in progress).

apache/sparknumber 51201

#51201 In apache/spark;

· EnricoMi opened on Jun 17, 2025

[SPARK-52508][CORE] Fallback storage retries FileNotFoundExceptions

CORE

Status: Open (in progress).

apache/sparknumber 51200

#51200 In apache/spark;

· EnricoMi opened on Jun 17, 2025

[SPARK-52509][K8S] Cleanup shuffles from fallback storage

CORE

Status: Open (in progress).

apache/sparknumber 51199

#51199 In apache/spark;

· EnricoMi opened on Jun 17, 2025

Better do idle python workers cleanup

CORE

PYTHON

Status: Draft (not ready).

apache/sparknumber 51143

#51143 In apache/spark;

· antban opened on Jun 10, 2025

[SPARK-51168][BUILD] Test Hadoop 3.4.2

BUILD

CORE

SQL

Status: Draft (not ready).

apache/sparknumber 51127

#51127 In apache/spark;

· pan3793 opened on Jun 9, 2025