Skip to content

[stable-24-3] Request DataShard compaction if scheme has been changed - #11532

Merged
kungasc merged 4 commits into
ydb-platform:stable-24-3from
kungasc:stable-24-3-compact-1-parted
Nov 13, 2024
Merged

[stable-24-3] Request DataShard compaction if scheme has been changed#11532
kungasc merged 4 commits into
ydb-platform:stable-24-3from
kungasc:stable-24-3-compact-1-parted

Conversation

@kungasc

@kungasc kungasc commented Nov 12, 2024 •
edited
Loading

Copy link
Copy Markdown
Contributor

Changelog entry

...

Changelog category

Добавлен механизм, принудительно запускающий фоновый компакшен при обнаружении несоответствий между хранящимися данными DataShard и заданной схемой.

Added a mechanism to forcibly trigger background compaction when differences between the stored DataShard data and the specified schema are detected.

Additional information

#11147

@kungasc kungasc changed the title Stable-24-3-compact-1-parted [stable-24-3] Request DataShard compaction if scheme has been changeed Nov 12, 2024
@kungasc kungasc changed the title [stable-24-3] Request DataShard compaction if scheme has been changeed [stable-24-3] Request DataShard compaction if scheme has been changed Nov 12, 2024
@github-actions

github-actions Bot commented Nov 12, 2024 •
edited
Loading

Copy link
Copy Markdown
Contributor

⚪ 2024-11-12 14:43:42 UTC Pre-commit check for a2a56a4 has started.
⚪ 2024-11-12 14:46:53 UTC Build linux-x86_64-release-clang14 is running...
⚫ 2024-11-12 14:54:26 UTC Check cancelled

@github-actions

github-actions Bot commented Nov 12, 2024 •
edited
Loading

Copy link
Copy Markdown
Contributor

⚪ 2024-11-12 14:43:53 UTC Pre-commit check for a2a56a4 has started.
⚪ 2024-11-12 14:47:01 UTC Build linux-x86_64-release-asan is running...
⚫ 2024-11-12 14:54:27 UTC Check cancelled

@github-actions

github-actions Bot commented Nov 12, 2024 •
edited
Loading

Copy link
Copy Markdown
Contributor

⚪ 2024-11-12 14:43:53 UTC Pre-commit check for a2a56a4 has started.
⚪ 2024-11-12 14:46:50 UTC Build linux-x86_64-relwithdebinfo is running...
🔴 2024-11-12 14:53:20 UTC Build failed. see the build logs.
🔴 2024-11-12 14:53:22 UTC Tests run skipped.

@github-actions

github-actions Bot commented Nov 12, 2024 •
edited
Loading

Copy link
Copy Markdown
Contributor

⚪ 2024-11-12 14:55:58 UTC Pre-commit check for 67f735b has started.
⚪ 2024-11-12 14:58:55 UTC Build linux-x86_64-release-clang14 is running...
🔴 2024-11-12 15:03:18 UTC Build failed. see the build logs.

@github-actions

github-actions Bot commented Nov 12, 2024 •
edited
Loading

Copy link
Copy Markdown
Contributor

⚪ 2024-11-12 14:55:59 UTC Pre-commit check for 67f735b has started.
⚪ 2024-11-12 14:58:56 UTC Build linux-x86_64-release-asan is running...
🔴 2024-11-12 15:10:05 UTC Build failed. see the build logs.
🔴 2024-11-12 15:10:07 UTC Tests run skipped.

@github-actions

github-actions Bot commented Nov 12, 2024 •
edited
Loading

Copy link
Copy Markdown
Contributor

⚪ 2024-11-12 14:58:56 UTC Pre-commit check for 67f735b has started.
⚪ 2024-11-12 15:01:54 UTC Build linux-x86_64-relwithdebinfo is running...
🔴 2024-11-12 15:14:06 UTC Build failed. see the build logs.
🔴 2024-11-12 15:14:08 UTC Tests run skipped.

@kungasc kungasc self-assigned this Nov 12, 2024
@github-actions

github-actions Bot commented Nov 12, 2024 •
edited
Loading

Copy link
Copy Markdown
Contributor

⚪ 2024-11-12 15:30:37 UTC Pre-commit check for 54c10da has started.
⚪ 2024-11-12 15:33:46 UTC Build linux-x86_64-relwithdebinfo is running...
🔴 2024-11-12 15:58:26 UTC Build failed. see the build logs.
🔴 2024-11-12 15:58:28 UTC Tests run skipped.
🟢 2024-11-12 15:59:02 UTC ydbd size 8.3 GiB changed* by +43.8 KiB, which is < 100.0 KiB vs stable-24-3: OK

ydbd size dash stable-24-3: afbd118 merge: 54c10da diff diff %
ydbd size 8 858 816 656 Bytes 8 858 861 488 Bytes +43.8 KiB +0.001%
ydbd stripped size 483 705 224 Bytes 483 709 064 Bytes +3.8 KiB +0.001%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@github-actions

github-actions Bot commented Nov 12, 2024 •
edited
Loading

Copy link
Copy Markdown
Contributor

⚪ 2024-11-12 15:31:05 UTC Pre-commit check for 54c10da has started.
⚪ 2024-11-12 15:34:01 UTC Build linux-x86_64-release-asan is running...
🔴 2024-11-12 15:54:24 UTC Build failed. see the build logs.
🔴 2024-11-12 15:54:25 UTC Tests run skipped.

@github-actions

github-actions Bot commented Nov 12, 2024 •
edited
Loading

Copy link
Copy Markdown
Contributor

⚪ 2024-11-12 15:33:13 UTC Pre-commit check for 54c10da has started.
⚪ 2024-11-12 15:36:17 UTC Build linux-x86_64-release-clang14 is running...
⚫ 2024-11-12 16:07:49 UTC Check cancelled

@github-actions

github-actions Bot commented Nov 12, 2024 •
edited
Loading

Copy link
Copy Markdown
Contributor

⚪ 2024-11-12 16:09:21 UTC Pre-commit check for 7b3adab has started.
⚪ 2024-11-12 16:12:19 UTC Build linux-x86_64-release-asan is running...
🟢 2024-11-12 16:35:43 UTC Build successful.
⚪ 2024-11-12 16:36:01 UTC Tests are running...
🔴 2024-11-12 18:46:36 UTC Some tests failed, follow the links below.

Test history | Test log

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
11739 11653 0 20 24 42

🟢 2024-11-12 18:47:17 UTC ydbd size 5.6 GiB changed* by +53.2 KiB, which is < 100.0 KiB vs stable-24-3: OK

ydbd size dash stable-24-3: afbd118 merge: 7b3adab diff diff %
ydbd size 5 991 968 752 Bytes 5 992 023 208 Bytes +53.2 KiB +0.001%
ydbd stripped size 1 501 736 064 Bytes 1 501 753 120 Bytes +16.7 KiB +0.001%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@github-actions

github-actions Bot commented Nov 12, 2024 •
edited
Loading

Copy link
Copy Markdown
Contributor

⚪ 2024-11-12 16:10:54 UTC Pre-commit check for 7b3adab has started.
⚪ 2024-11-12 16:14:05 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-11-12 16:54:36 UTC Build successful.
⚪ 2024-11-12 16:54:54 UTC Tests are running...
🔴 2024-11-12 18:44:42 UTC Some tests failed, follow the links below.

Test history | Test log

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
40298 35027 0 14 5217 40

🟢 2024-11-12 18:45:29 UTC ydbd size 8.3 GiB changed* by +43.8 KiB, which is < 100.0 KiB vs stable-24-3: OK

ydbd size dash stable-24-3: afbd118 merge: 7b3adab diff diff %
ydbd size 8 858 816 656 Bytes 8 858 861 488 Bytes +43.8 KiB +0.001%
ydbd stripped size 483 705 224 Bytes 483 709 064 Bytes +3.8 KiB +0.001%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@github-actions

github-actions Bot commented Nov 12, 2024 •
edited
Loading

Copy link
Copy Markdown
Contributor

⚪ 2024-11-12 16:11:53 UTC Pre-commit check for 7b3adab has started.
⚪ 2024-11-12 16:14:51 UTC Build linux-x86_64-release-clang14 is running...
🟢 2024-11-12 16:26:43 UTC Build successful.

@kungasc
kungasc marked this pull request as ready for review November 13, 2024 08:28
@kungasc
kungasc requested a review from a team as a code owner November 13, 2024 08:28
@kungasc
kungasc merged commit 271c9f9 into ydb-platform:stable-24-3 Nov 13, 2024
zinal pushed a commit to zinal/ydb_fork that referenced this pull request Nov 30, 2024
@kungasc @zinal
[stable-24-3] Request DataShard compaction if scheme has been changed (…
660b105 
…ydb-platform#11532)
This was referenced Jun 3, 2025
Closed
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@fomichev3000 fomichev3000 fomichev3000 approved these changes

Assignees

@kungasc kungasc

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@kungasc @fomichev3000