Skip to content

24-1: Fix race between table merge and borrowed gc compaction. Fixes #3154. - #3165

Merged
snaury merged 1 commit into
ydb-platform:stable-24-1from
snaury:fix-3154-merge-compact-borrowed-race-24-1
Mar 26, 2024
Merged

snaury merged 1 commit into
ydb-platform:stable-24-1from
snaury:fix-3154-merge-compact-borrowed-race-24-1

Conversation

@snaury

@snaury snaury commented Mar 26, 2024

Copy link
Copy Markdown
Member

Changelog entry

Fixed a race between table merge and borrowed gc compaction.

Changelog category

  • Bugfix

Additional information

A fix in #2286 introduced a race, where datashard allowed local database to compact borrowed data before all borrowed data is actually loaded and merged into the table. This caused local database borrowed compaction to later fail due to unexpected epoch invariant violations.

Fixes #3154.

@snaury snaury self-assigned this Mar 26, 2024
@github-actions

github-actions Bot commented Mar 26, 2024

Copy link
Copy Markdown
Contributor

2024-03-26 13:30:50 UTC Pre-commit check for 8a3e31d has started.
2024-03-26 13:30:52 UTC Build linux-x86_64-release-asan is running...
🟢 2024-03-26 13:34:05 UTC Build successful.
2024-03-26 13:34:23 UTC Tests are running...
🔴 2024-03-26 15:10:01 UTC Some tests failed, follow the links below.

Test history

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
16059 15949 0 14 58 38

@github-actions

github-actions Bot commented Mar 26, 2024

Copy link
Copy Markdown
Contributor

2024-03-26 13:33:04 UTC Pre-commit check for 8a3e31d has started.
2024-03-26 13:33:07 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-03-26 13:36:09 UTC Build successful.
2024-03-26 13:38:08 UTC Tests are running...
🟢 2024-03-26 14:54:17 UTC Tests successful.

Test history

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
60384 50984 0 0 9340 60

@snaury
snaury marked this pull request as ready for review March 26, 2024 14:07
@snaury
snaury requested a review from a team as a code owner March 26, 2024 14:07
@snaury snaury changed the title Fix race between table merge and borrowed gc compaction. Fixes #3154. 24-1: Fix race between table merge and borrowed gc compaction. Fixes #3154. Mar 26, 2024
@snaury
snaury merged commit 6fbfd4a into ydb-platform:stable-24-1 Mar 26, 2024
@snaury
snaury deleted the fix-3154-merge-compact-borrowed-race-24-1 branch March 26, 2024 15:52
@mregrock mregrock mentioned this pull request May 15, 2024
This was referenced Jun 7, 2024
@CyberROFL CyberROFL mentioned this pull request Jun 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants