Skip to content

Conversation

@zifeif2
Copy link

@zifeif2 zifeif2 commented Nov 20, 2025

What changes were proposed in this pull request?

Remove withTempDir in test("SPARK-54063: forceSnapshot metric populated when shouldForceSnapshotOnCommit is true") because it breaks RocksDB UI Backend CI by causing a timeout https://github.com/apache/spark/actions/runs/19527445536/job/55950300126

Why are the changes needed?

See above

Does this PR introduce any user-facing change?

No

How was this patch tested?

No

Was this patch authored or co-authored using generative AI tooling?

No

Copy link
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you, @zifeif2 . I verified locally.

@dongjoon-hyun dongjoon-hyun changed the title [SPARK-54063][SS] Fix timeout test introduced in PR-52773 [SPARK-54063][SS] Remove withTempDirFix from SPARK-54063: forceSnapshot metric populated when shouldForceSnapshotOnCommit is true test Nov 20, 2025
Copy link
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pending CIs.

@dongjoon-hyun dongjoon-hyun changed the title [SPARK-54063][SS] Remove withTempDirFix from SPARK-54063: forceSnapshot metric populated when shouldForceSnapshotOnCommit is true test [SPARK-54063][SS][FOLLOWUP] Remove withTempDirFix from SPARK-54063: forceSnapshot metric populated when shouldForceSnapshotOnCommit is true test Nov 20, 2025
@dongjoon-hyun dongjoon-hyun changed the title [SPARK-54063][SS][FOLLOWUP] Remove withTempDirFix from SPARK-54063: forceSnapshot metric populated when shouldForceSnapshotOnCommit is true test [SPARK-54063][SS][FOLLOWUP] Remove withTempDirFix from forceSnapshot metric populated when shouldForceSnapshotOnCommit is true test Nov 20, 2025
@dongjoon-hyun
Copy link
Member

I verified manually both test suites with/without LIVE_UI_LOCAL_STORE_DIR.
Merged to master to recover the CI.

@dongjoon-hyun
Copy link
Member

dongjoon-hyun commented Nov 20, 2025

To make it sure, I triggered the CI here.

/usr/bin/git log -1 --format=%H
98e36730c405a3b9202522ee1809322f40a20217

@gengliangwang
Copy link
Member

Thanks for the quick fix, @zifeif2 !

zifeif2 pushed a commit to zifeif2/spark that referenced this pull request Nov 25, 2025
…ot metric populated when shouldForceSnapshotOnCommit is true` test

### What changes were proposed in this pull request?

Remove `withTempDir` in  `test("SPARK-54063: forceSnapshot metric populated when shouldForceSnapshotOnCommit is true")` because it breaks RocksDB UI Backend CI  by causing a timeout https://github.com/apache/spark/actions/runs/19527445536/job/55950300126

### Why are the changes needed?

See above

### Does this PR introduce _any_ user-facing change?

No
### How was this patch tested?

No

### Was this patch authored or co-authored using generative AI tooling?

No

Closes apache#53141 from zifeif2/fix-trigger-test.

Authored-by: Ubuntu <zifei.feng@your.hostname.com>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
huangxiaopingRD pushed a commit to huangxiaopingRD/spark that referenced this pull request Nov 25, 2025
…ot metric populated when shouldForceSnapshotOnCommit is true` test

### What changes were proposed in this pull request?

Remove `withTempDir` in  `test("SPARK-54063: forceSnapshot metric populated when shouldForceSnapshotOnCommit is true")` because it breaks RocksDB UI Backend CI  by causing a timeout https://github.com/apache/spark/actions/runs/19527445536/job/55950300126

### Why are the changes needed?

See above

### Does this PR introduce _any_ user-facing change?

No
### How was this patch tested?

No

### Was this patch authored or co-authored using generative AI tooling?

No

Closes apache#53141 from zifeif2/fix-trigger-test.

Authored-by: Ubuntu <zifei.feng@your.hostname.com>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants