Skip to content
Build

[SPARK-47050][SQL] Collect and publish partition level metrics #23

Sign in to view logs

[SPARK-47050][SQL] Collect and publish partition level metrics

[SPARK-47050][SQL] Collect and publish partition level metrics #23

Triggered via push April 23, 2024 16:26
@snmvaughansnmvaughan
pushed 2341c22
feature/SPARK-47050-v1
Status Success
Total duration 1h 50m 26s
Artifacts 23

build_main.yml

on: push
Run  /  Check changes
33s
Run / Check changes
Run  /  Base image build
46s
Run / Base image build
Run  /  Protobuf breaking change detection and Python CodeGen check
1m 7s
Run / Protobuf breaking change detection and Python CodeGen check
Run  /  Run TPC-DS queries with SF=1
1h 18m
Run / Run TPC-DS queries with SF=1
Run  /  Run Docker integration tests
42m 53s
Run / Run Docker integration tests
Run  /  Run Spark on Kubernetes Integration test
57m 9s
Run / Run Spark on Kubernetes Integration test
Run  /  Run Spark UI tests
27s
Run / Run Spark UI tests
Matrix: Run / build
Matrix: Run / maven-build
Run  /  Build modules: sparkr
29m 56s
Run / Build modules: sparkr
Run  /  Linters, licenses, dependencies and documentation generation
58m 2s
Run / Linters, licenses, dependencies and documentation generation
Matrix: Run / pyspark
Fit to window
Zoom out
Zoom in

Annotations

10 errors and 1 warning
Run / Run Spark on Kubernetes Integration test
HashSet() did not contain "decomtest-2b20918f0bdf4cfb-exec-1".
Run / Run Spark on Kubernetes Integration test
HashSet() did not contain "decomtest-9bf8528f0be031af-exec-1".
Run / Run Spark on Kubernetes Integration test
sleep interrupted
Run / Run Spark on Kubernetes Integration test
sleep interrupted
Run / Run Spark on Kubernetes Integration test
Task io.fabric8.kubernetes.client.utils.internal.SerialExecutor$$Lambda$621/0x00007ff5305298c0@6954f7f0 rejected from java.util.concurrent.ThreadPoolExecutor@5c42af3d[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 400]
Run / Run Spark on Kubernetes Integration test
Task io.fabric8.kubernetes.client.utils.internal.SerialExecutor$$Lambda$621/0x00007ff5305298c0@106a3523 rejected from java.util.concurrent.ThreadPoolExecutor@5c42af3d[Shutting down, pool size = 2, active threads = 2, queued tasks = 0, completed tasks = 399]
Run / Run Spark on Kubernetes Integration test
HashSet() did not contain "decomtest-dfeedb8f0bf1f81a-exec-1".
Run / Run Spark on Kubernetes Integration test
HashSet() did not contain "decomtest-0c6da78f0bf2db53-exec-1".
Run / Run Spark on Kubernetes Integration test
HashSet() did not contain "decomtest-2bc8bd8f0bf66dd2-exec-1".
Run / Run Spark on Kubernetes Integration test
Status(apiVersion=v1, code=404, details=StatusDetails(causes=[], group=null, kind=pods, name=spark-test-app-c92ca92b4fa74c1cbb269dbe4f17558e-driver, retryAfterSeconds=null, uid=null, additionalProperties={}), kind=Status, message=pods "spark-test-app-c92ca92b4fa74c1cbb269dbe4f17558e-driver" not found, metadata=ListMeta(_continue=null, remainingItemCount=null, resourceVersion=null, selfLink=null, additionalProperties={}), reason=NotFound, status=Failure, additionalProperties={})..
Run / Build modules: pyspark-core, pyspark-errors, pyspark-streaming
No files were found with the provided path: **/target/test-reports/*.xml. No artifacts will be uploaded.

Artifacts

Produced during runtime
Name Size
site Expired
62.9 MB
test-results-api, catalyst, hive-thriftserver--17-hadoop3-hive2.3 Expired
622 KB
test-results-core, unsafe, kvstore, avro, utils, network-common, network-shuffle, repl, launcher, examples, sketch, variant--17-hadoop3-hive2.3 Expired
36.7 KB
test-results-docker-integration--17-hadoop3-hive2.3 Expired
40.7 KB
test-results-hive-- other tests-17-hadoop3-hive2.3 Expired
219 KB
test-results-hive-- slow tests-17-hadoop3-hive2.3 Expired
209 KB
test-results-mllib-local, mllib, graphx--17-hadoop3-hive2.3 Expired
428 KB
test-results-pyspark-connect--17-hadoop3-hive2.3-python3.9 Expired
106 KB
test-results-pyspark-mllib, pyspark-ml, pyspark-ml-connect--17-hadoop3-hive2.3-python3.9 Expired
181 KB
test-results-pyspark-pandas--17-hadoop3-hive2.3-python3.9 Expired
193 KB
test-results-pyspark-pandas-connect-part0--17-hadoop3-hive2.3-python3.9 Expired
128 KB
test-results-pyspark-pandas-connect-part1--17-hadoop3-hive2.3-python3.9 Expired
90.3 KB
test-results-pyspark-pandas-connect-part2--17-hadoop3-hive2.3-python3.9 Expired
83.9 KB
test-results-pyspark-pandas-connect-part3--17-hadoop3-hive2.3-python3.9 Expired
81.5 KB
test-results-pyspark-pandas-slow--17-hadoop3-hive2.3-python3.9 Expired
173 KB
test-results-pyspark-sql, pyspark-resource, pyspark-testing--17-hadoop3-hive2.3-python3.9 Expired
102 KB
test-results-sparkr--17-hadoop3-hive2.3 Expired
17.3 KB
test-results-sql-- extended tests-17-hadoop3-hive2.3 Expired
1 MB
test-results-sql-- other tests-17-hadoop3-hive2.3 Expired
1.18 MB
test-results-sql-- slow tests-17-hadoop3-hive2.3 Expired
1020 KB
test-results-streaming, sql-kafka-0-10, streaming-kafka-0-10, streaming-kinesis-asl, kubernetes, hadoop-cloud, spark-ganglia-lgpl, protobuf--17-hadoop3-hive2.3 Expired
62.1 KB
test-results-tpcds--17-hadoop3-hive2.3 Expired
4.87 KB
test-results-yarn, connect--17-hadoop3-hive2.3 Expired
102 KB