Skip to content
Rust

[#1787] feat(spark): Fine grained stage retry switch for fetch/write failure #1903

Sign in to view logs

[#1787] feat(spark): Fine grained stage retry switch for fetch/write failure

[#1787] feat(spark): Fine grained stage retry switch for fetch/write failure #1903

Triggered via pull request June 20, 2024 08:32
@zustonzuston
synchronize #1788
zuston:stageRetryPlusWithSwitch
Status Success
Total duration 5m 8s
Artifacts –

rust.yml

on: pull_request
Matrix: build
Fit to window
Zoom out
Zoom in

Annotations

12 errors, 4 warnings, and 3 notices
8 out of 10 runs with error: testRSSStageResubmit (org.apache.uniffle.test.RSSStageDynamicServerReWriteTest): org.apache.uniffle.test.RSSStageDynamicServerReWriteTest#L0
artifacts/test-reports-spark3.0/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RSSStageDynamicServerReWriteTest.xml [took 14s] artifacts/test-reports-spark3.2.0/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RSSStageDynamicServerReWriteTest.xml [took 11s] artifacts/test-reports-spark3.2/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RSSStageDynamicServerReWriteTest.xml [took 11s] artifacts/test-reports-spark3.3/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RSSStageDynamicServerReWriteTest.xml [took 12s] artifacts/test-reports-spark3.4/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RSSStageDynamicServerReWriteTest.xml [took 12s] artifacts/test-reports-spark3.5-scala2.13/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RSSStageDynamicServerReWriteTest.xml [took 12s] artifacts/test-reports-spark3.5/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RSSStageDynamicServerReWriteTest.xml [took 13s] artifacts/test-reports-spark3/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RSSStageDynamicServerReWriteTest.xml [took 12s]
8 out of 10 runs with error: testRssShuffleManager{boolean}[1] (org.apache.uniffle.test.RssShuffleManagerTest): org.apache.uniffle.test.RssShuffleManagerTest#L0
artifacts/test-reports-spark3.0/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.2.0/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.2/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.3/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.4/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.5-scala2.13/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.5/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s]
8 out of 10 runs with error: testRssShuffleManager{boolean}[2] (org.apache.uniffle.test.RssShuffleManagerTest): org.apache.uniffle.test.RssShuffleManagerTest#L0
artifacts/test-reports-spark3.0/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.2.0/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.2/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.3/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.4/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.5-scala2.13/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.5/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s]
8 out of 10 runs with error: testRssShuffleManagerClientConfOverride{boolean}[1] (org.apache.uniffle.test.RssShuffleManagerTest): org.apache.uniffle.test.RssShuffleManagerTest#L0
artifacts/test-reports-spark3.0/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.2.0/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.2/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.3/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.4/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.5-scala2.13/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.5/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s]
8 out of 10 runs with error: testRssShuffleManagerClientConfOverride{boolean}[2] (org.apache.uniffle.test.RssShuffleManagerTest): org.apache.uniffle.test.RssShuffleManagerTest#L0
artifacts/test-reports-spark3.0/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.2.0/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.2/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.3/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.4/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.5-scala2.13/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.5/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s]
8 out of 10 runs with error: testRssShuffleManagerClientConf{BlockIdLayout}[1] (org.apache.uniffle.test.RssShuffleManagerTest): org.apache.uniffle.test.RssShuffleManagerTest#L0
artifacts/test-reports-spark3.0/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.2.0/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.2/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.3/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.4/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.5-scala2.13/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.5/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s]
8 out of 10 runs with error: testRssShuffleManagerClientConf{BlockIdLayout}[2] (org.apache.uniffle.test.RssShuffleManagerTest): org.apache.uniffle.test.RssShuffleManagerTest#L0
artifacts/test-reports-spark3.0/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.2.0/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.2/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.3/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.4/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.5-scala2.13/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.5/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s]
8 out of 10 runs with error: testRssShuffleManagerClientConf{BlockIdLayout}[3] (org.apache.uniffle.test.RssShuffleManagerTest): org.apache.uniffle.test.RssShuffleManagerTest#L0
artifacts/test-reports-spark3.0/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.2.0/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.2/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.3/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.4/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.5-scala2.13/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.5/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s]
8 out of 10 runs with error: testRssShuffleManagerDynamicClientConf{BlockIdLayout}[1] (org.apache.uniffle.test.RssShuffleManagerTest): org.apache.uniffle.test.RssShuffleManagerTest#L0
artifacts/test-reports-spark3.0/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.2.0/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.2/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.3/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.4/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.5-scala2.13/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.5/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s]
8 out of 10 runs with error: testRssShuffleManagerDynamicClientConf{BlockIdLayout}[2] (org.apache.uniffle.test.RssShuffleManagerTest): org.apache.uniffle.test.RssShuffleManagerTest#L0
artifacts/test-reports-spark3.0/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.2.0/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.2/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.3/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.4/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.5-scala2.13/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.5/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s]
8 out of 10 runs with error: testRssShuffleManagerDynamicClientConf{BlockIdLayout}[3] (org.apache.uniffle.test.RssShuffleManagerTest): org.apache.uniffle.test.RssShuffleManagerTest#L0
artifacts/test-reports-spark3.0/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.2.0/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.2/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.3/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.4/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.5-scala2.13/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3.5/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s] artifacts/test-reports-spark3/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RssShuffleManagerTest.xml [took 3s]
8 out of 10 runs with error: testRSSStageResubmit (org.apache.uniffle.test.RSSStageResubmitTest): org.apache.uniffle.test.RSSStageResubmitTest#L0
artifacts/test-reports-spark3.0/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RSSStageResubmitTest.xml [took 2s] artifacts/test-reports-spark3.2.0/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RSSStageResubmitTest.xml [took 2s] artifacts/test-reports-spark3.2/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RSSStageResubmitTest.xml [took 2s] artifacts/test-reports-spark3.3/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RSSStageResubmitTest.xml [took 2s] artifacts/test-reports-spark3.4/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RSSStageResubmitTest.xml [took 2s] artifacts/test-reports-spark3.5-scala2.13/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RSSStageResubmitTest.xml [took 2s] artifacts/test-reports-spark3.5/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RSSStageResubmitTest.xml [took 2s] artifacts/test-reports-spark3/integration-test/spark-common/target/surefire-reports/TEST-org.apache.uniffle.test.RSSStageResubmitTest.xml [took 2s]
1 skipped test found
There is 1 skipped test, see "Raw output" for the name of the skipped test.
936 tests found (test 1 to 720)
There are 936 tests, see "Raw output" for the list of tests 1 to 720.
936 tests found (test 721 to 936)
There are 936 tests, see "Raw output" for the list of tests 721 to 936.
build
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: arduino/setup-protoc@v2, actions/checkout@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
build (memory-prof)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: arduino/setup-protoc@v2, actions/checkout@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
All 8 runs failed: testCreateShuffleManagerServer (org.apache.spark.shuffle.RssShuffleManagerTest): org.apache.spark.shuffle.RssShuffleManagerTest#L0
artifacts/test-reports-spark3.0/client-spark/spark3/target/surefire-reports/TEST-org.apache.spark.shuffle.RssShuffleManagerTest.xml [took 0s] artifacts/test-reports-spark3.2.0/client-spark/spark3/target/surefire-reports/TEST-org.apache.spark.shuffle.RssShuffleManagerTest.xml [took 0s] artifacts/test-reports-spark3.2/client-spark/spark3/target/surefire-reports/TEST-org.apache.spark.shuffle.RssShuffleManagerTest.xml [took 0s] artifacts/test-reports-spark3.3/client-spark/spark3/target/surefire-reports/TEST-org.apache.spark.shuffle.RssShuffleManagerTest.xml [took 0s] artifacts/test-reports-spark3.4/client-spark/spark3/target/surefire-reports/TEST-org.apache.spark.shuffle.RssShuffleManagerTest.xml [took 0s] artifacts/test-reports-spark3.5-scala2.13/client-spark/spark3/target/surefire-reports/TEST-org.apache.spark.shuffle.RssShuffleManagerTest.xml [took 0s] artifacts/test-reports-spark3.5/client-spark/spark3/target/surefire-reports/TEST-org.apache.spark.shuffle.RssShuffleManagerTest.xml [took 0s] artifacts/test-reports-spark3/client-spark/spark3/target/surefire-reports/TEST-org.apache.spark.shuffle.RssShuffleManagerTest.xml [took 0s]
All 8 runs failed: testWithStageRetry (org.apache.spark.shuffle.RssShuffleManagerTest): org.apache.spark.shuffle.RssShuffleManagerTest#L0
artifacts/test-reports-spark3.0/client-spark/spark3/target/surefire-reports/TEST-org.apache.spark.shuffle.RssShuffleManagerTest.xml [took 0s] artifacts/test-reports-spark3.2.0/client-spark/spark3/target/surefire-reports/TEST-org.apache.spark.shuffle.RssShuffleManagerTest.xml [took 0s] artifacts/test-reports-spark3.2/client-spark/spark3/target/surefire-reports/TEST-org.apache.spark.shuffle.RssShuffleManagerTest.xml [took 0s] artifacts/test-reports-spark3.3/client-spark/spark3/target/surefire-reports/TEST-org.apache.spark.shuffle.RssShuffleManagerTest.xml [took 0s] artifacts/test-reports-spark3.4/client-spark/spark3/target/surefire-reports/TEST-org.apache.spark.shuffle.RssShuffleManagerTest.xml [took 0s] artifacts/test-reports-spark3.5-scala2.13/client-spark/spark3/target/surefire-reports/TEST-org.apache.spark.shuffle.RssShuffleManagerTest.xml [took 0s] artifacts/test-reports-spark3.5/client-spark/spark3/target/surefire-reports/TEST-org.apache.spark.shuffle.RssShuffleManagerTest.xml [took 0s] artifacts/test-reports-spark3/client-spark/spark3/target/surefire-reports/TEST-org.apache.spark.shuffle.RssShuffleManagerTest.xml [took 0s]