Skip to content

Conversation

@dongjoon-hyun
Copy link
Member

@dongjoon-hyun dongjoon-hyun commented Nov 21, 2025

What changes were proposed in this pull request?

This PR aims to disable a flaky unmanaged memory tracking with off-heap memory enabled test in MacOS CI

Why are the changes needed?

This test suite passed locally, but has been flaky in MacOS GitHub Action environment.

- unmanaged memory tracking with off-heap memory enabled *** FAILED ***
  1400 was not less than or equal to 1200 Off-heap memory should be reduced by unmanaged usage (UnifiedMemoryManagerSuite.scala:592)
- unmanaged memory tracking with off-heap memory enabled *** FAILED ***
  mm.acquireStorageMemory(UnifiedMemoryManagerSuite.this.dummyBlock, 1100L, OFF_HEAP) was true (UnifiedMemoryManagerSuite.scala:600)

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Pass the CIs.

Was this patch authored or co-authored using generative AI tooling?

No.

… with off-heap memory enabled` test in MacOS CI
@github-actions github-actions bot added the CORE label Nov 21, 2025
@dongjoon-hyun dongjoon-hyun changed the title [SPARK-54455][CORE][TESTS] Disable a flaky unmanaged memory trackingwith off-heap memory enabled test in MacOS CI [SPARK-54455][CORE][TESTS] Disable a flaky unmanaged memory tracking with off-heap memory enabled test in MacOS CI Nov 21, 2025
@dongjoon-hyun
Copy link
Member Author

All tests passed. I'm going to merge this to stabilize the CIs and unblock Apache Spark 4.1.0 release.

dongjoon-hyun added a commit that referenced this pull request Nov 22, 2025
… with off-heap memory enabled` test in MacOS CI

### What changes were proposed in this pull request?

This PR aims to disable a flaky `unmanaged memory tracking with off-heap memory enabled` test in MacOS CI

### Why are the changes needed?

This test suite passed locally, but has been flaky in MacOS GitHub Action environment.

- https://github.com/apache/spark/actions/runs/19442963476/job/55985972662
```
- unmanaged memory tracking with off-heap memory enabled *** FAILED ***
  1400 was not less than or equal to 1200 Off-heap memory should be reduced by unmanaged usage (UnifiedMemoryManagerSuite.scala:592)
```

- https://github.com/apache/spark/actions/runs/19582140886/job/56082446144
```
- unmanaged memory tracking with off-heap memory enabled *** FAILED ***
  mm.acquireStorageMemory(UnifiedMemoryManagerSuite.this.dummyBlock, 1100L, OFF_HEAP) was true (UnifiedMemoryManagerSuite.scala:600)
```

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Pass the CIs.

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes #53165 from dongjoon-hyun/SPARK-54455.

Authored-by: Dongjoon Hyun <dongjoon@apache.org>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
(cherry picked from commit 371b00a)
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
@dongjoon-hyun dongjoon-hyun deleted the SPARK-54455 branch November 22, 2025 01:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant