Skip to content

Disable Incompatible Tests with Remote Compaction#13843

Closed
jaykorean wants to merge 1 commit intofacebook:mainfrom
jaykorean:disable_incompatible_remote_compaction_tests
Closed

Disable Incompatible Tests with Remote Compaction#13843
jaykorean wants to merge 1 commit intofacebook:mainfrom
jaykorean:disable_incompatible_remote_compaction_tests

Conversation

@jaykorean
Copy link
Contributor

@jaykorean jaykorean commented Aug 6, 2025

Summary

To reduce the noise, disable the incompatible ones for now when remote_compaction_worker_threads > 0. We will investigate each, fix as needed and re-enable them as follow up.

Test Plan

python3 -u tools/db_crashtest.py blackbox --remote_compaction_worker_threads=8 --interval=5 --duration=6000 --continuous_verification_interval=10 --disable_wal=1 --use_txn=1 --enable_pipelined_write=0 --checkpoint_one_in=0 --use_timed_put_one_in=0

@meta-cla meta-cla bot added the CLA Signed label Aug 6, 2025
@jaykorean jaykorean requested a review from cbi42 August 6, 2025 17:20
@jaykorean jaykorean marked this pull request as ready for review August 6, 2025 17:20
@facebook-github-bot
Copy link
Contributor

@jaykorean has imported this pull request. If you are a Meta employee, you can view this in D79735166.

@jaykorean jaykorean force-pushed the disable_incompatible_remote_compaction_tests branch from 6f22d2c to f7bbf79 Compare August 6, 2025 17:22
@facebook-github-bot
Copy link
Contributor

@jaykorean has imported this pull request. If you are a Meta employee, you can view this in D79735166.

@jaykorean jaykorean force-pushed the disable_incompatible_remote_compaction_tests branch from f7bbf79 to 8293753 Compare August 6, 2025 17:31
@facebook-github-bot
Copy link
Contributor

@jaykorean has imported this pull request. If you are a Meta employee, you can view this in D79735166.

@facebook-github-bot
Copy link
Contributor

@jaykorean merged this pull request in 3dd6c6f.

facebook-github-bot pushed a commit that referenced this pull request Aug 7, 2025
…tion in Stress Test (#13845)

Summary:
We temporarily disabled WAL when Remote Compaction is enabled in Stress Test (#13843). There are few others to incompatible features when WAL is disabled. Due to the sanitization order, WAL was disabled at the end of the sanitization and these incompatible features weren't set properly. Stress Test failed with an error like the following.

e.g. `reopen` stress test is not compatible with `disable_wal` - `Error: Db cannot reopen safely with disable_wal set!`

This PR changes the order of sanitization so that `disable_wal` is set earlier when `remote_compaction_worker_threads > 0`

Pull Request resolved: #13845

Test Plan:
```
python3 -u tools/db_crashtest.py blackbox --remote_compaction_worker_threads=8 --interval=5 --duration=6000 --continuous_verification_interval=10 --disable_wal=1 --use_txn=1 --txn_write_policy=2 --enable_pipelined_write=0 --checkpoint_one_in=0 --use_timed_put_one_in=0
```

Reviewed By: cbi42

Differential Revision: D79758670

Pulled By: jaykorean

fbshipit-source-id: aa6f4a74cc86c23f442928c301187b06e8137f53
facebook-github-bot pushed a commit that referenced this pull request Aug 7, 2025
Summary:
Previous attempts were not enough keep the stress test running with remote compaction enabled - #13845, #13843, #13835

We will disable the remote compaction in stress test and address this with a better strategy (using internal Meta infra)

Pull Request resolved: #13848

Test Plan: CI

Reviewed By: cbi42

Differential Revision: D79816733

Pulled By: jaykorean

fbshipit-source-id: e93b037adf4f775202e06c3fd4aa8a3b4b85c274
@jaykorean jaykorean deleted the disable_incompatible_remote_compaction_tests branch September 4, 2025 02:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants