Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix HugeBlob keeper log cutting logic #4606

Merged

Conversation

alexvru
Copy link
Collaborator

@alexvru alexvru commented May 16, 2024

Changelog entry

Fix HugeBlob keeper log cutting logic

Changelog category

  • Bugfix

Additional information

Log cutting logic in HugeBlob keeper was someplace excessive and someplace incorrect. Now it is fixed. Under the new approach, only EntryPointLsn matters when choosing what to keep in log, but also volatile in-flight states for HugeBlobLogLsn and LSM tree entrypoints with FreedHugeBlobs vector. Upon recovery, all items are read in correct order and volatile state does not contribute in the correctness.

Copy link

github-actions bot commented May 16, 2024

2024-05-16 11:49:27 UTC Pre-commit check for f8c4004 has started.
2024-05-16 11:49:29 UTC Build linux-x86_64-release-asan is running...
🔴 2024-05-16 11:51:29 UTC Build failed. see the build logs.
🔴 2024-05-16 11:52:59 UTC Tests run skipped.

Copy link

github-actions bot commented May 16, 2024

2024-05-16 13:16:25 UTC Pre-commit check for f8c4004 has started.
2024-05-16 13:16:27 UTC Build linux-x86_64-release-clang14 is running...
🔴 2024-05-16 13:18:39 UTC Build failed. see the build logs.

Copy link

github-actions bot commented May 16, 2024

2024-05-16 13:19:34 UTC Pre-commit check for f8c4004 has started.
2024-05-16 13:19:35 UTC Build linux-x86_64-relwithdebinfo is running...
🔴 2024-05-16 13:21:45 UTC Build failed. see the build logs.
🔴 2024-05-16 13:23:15 UTC Tests run skipped.

@alexvru alexvru force-pushed the vdisk/fix-huge-blob-keeper-log-cutting branch from 3759f12 to 3c6c80f Compare May 16, 2024 16:53
Copy link

github-actions bot commented May 16, 2024

2024-05-16 16:57:12 UTC Pre-commit check for 573dace has started.
2024-05-16 16:57:15 UTC Build linux-x86_64-relwithdebinfo is running...
2024-05-16 17:02:12 UTC Check cancelled

Copy link

github-actions bot commented May 16, 2024

2024-05-16 16:57:16 UTC Pre-commit check for 573dace has started.
2024-05-16 16:57:18 UTC Build linux-x86_64-release-clang14 is running...
2024-05-16 17:02:12 UTC Check cancelled

Copy link

github-actions bot commented May 16, 2024

2024-05-16 16:57:21 UTC Pre-commit check for 573dace has started.
2024-05-16 16:57:23 UTC Build linux-x86_64-release-asan is running...
2024-05-16 17:02:12 UTC Check cancelled

@alexvru alexvru force-pushed the vdisk/fix-huge-blob-keeper-log-cutting branch from 3c6c80f to 10ca9ec Compare May 16, 2024 17:01
Copy link

github-actions bot commented May 16, 2024

2024-05-16 17:03:38 UTC Pre-commit check for c56207d has started.
2024-05-16 17:03:39 UTC Build linux-x86_64-release-asan is running...
🟢 2024-05-16 17:36:39 UTC Build successful.
2024-05-16 17:38:34 UTC Tests are running...
🔴 2024-05-16 19:34:17 UTC Some tests failed, follow the links below.

Test history

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
10562 10199 0 55 296 12

Copy link

github-actions bot commented May 16, 2024

2024-05-16 17:06:02 UTC Pre-commit check for c56207d has started.
2024-05-16 17:06:04 UTC Build linux-x86_64-release-clang14 is running...
🟢 2024-05-16 17:36:43 UTC Build successful.

Copy link

github-actions bot commented May 16, 2024

2024-05-16 17:06:11 UTC Pre-commit check for c56207d has started.
2024-05-16 17:06:15 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-05-16 17:40:52 UTC Build successful.
2024-05-16 17:42:54 UTC Tests are running...
🔴 2024-05-16 19:25:20 UTC Some tests failed, follow the links below.

Test history

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
37930 33088 0 19 4809 14

@alexvru alexvru force-pushed the vdisk/fix-huge-blob-keeper-log-cutting branch from 10ca9ec to 9258f4a Compare May 16, 2024 20:43
Copy link

github-actions bot commented May 16, 2024

2024-05-16 20:46:29 UTC Pre-commit check for 9707484 has started.
2024-05-16 20:46:32 UTC Build linux-x86_64-release-clang14 is running...
🟢 2024-05-16 20:50:32 UTC Build successful.

Copy link

github-actions bot commented May 16, 2024

2024-05-16 20:46:39 UTC Pre-commit check for 9707484 has started.
2024-05-16 20:46:42 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-05-16 20:50:37 UTC Build successful.
2024-05-16 20:52:33 UTC Tests are running...
🔴 2024-05-16 22:39:12 UTC Some tests failed, follow the links below.

Test history

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
37932 33026 0 21 4867 18

Copy link

github-actions bot commented May 16, 2024

2024-05-16 20:46:52 UTC Pre-commit check for 9707484 has started.
2024-05-16 20:46:55 UTC Build linux-x86_64-release-asan is running...
🟢 2024-05-16 20:50:55 UTC Build successful.
2024-05-16 20:52:51 UTC Tests are running...
🔴 2024-05-16 22:50:28 UTC Some tests failed, follow the links below.

Test history

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
10563 10339 0 49 160 15

@alexvru alexvru force-pushed the vdisk/fix-huge-blob-keeper-log-cutting branch from 9258f4a to 60b2dc6 Compare May 17, 2024 08:32
Copy link

github-actions bot commented May 17, 2024

2024-05-17 08:36:17 UTC Pre-commit check for 458c39f has started.
2024-05-17 08:36:20 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-05-17 09:07:21 UTC Build successful.
2024-05-17 09:09:19 UTC Tests are running...
🔴 2024-05-17 10:39:03 UTC Some tests failed, follow the links below.

Test history

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
37925 33087 0 12 4816 10

Copy link

github-actions bot commented May 17, 2024

2024-05-17 08:36:17 UTC Pre-commit check for 458c39f has started.
2024-05-17 08:36:20 UTC Build linux-x86_64-release-clang14 is running...
🟢 2024-05-17 09:08:12 UTC Build successful.

Copy link

github-actions bot commented May 17, 2024

2024-05-17 08:36:19 UTC Pre-commit check for 458c39f has started.
2024-05-17 08:36:22 UTC Build linux-x86_64-release-asan is running...
🟢 2024-05-17 09:08:03 UTC Build successful.
2024-05-17 09:09:59 UTC Tests are running...
🔴 2024-05-17 11:02:02 UTC Some tests failed, follow the links below.

Test history

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
10563 10201 0 53 300 9

@alexvru alexvru enabled auto-merge (squash) May 17, 2024 11:08
@alexvru alexvru merged commit 9241d2e into ydb-platform:main May 17, 2024
3 of 5 checks passed
@alexvru alexvru deleted the vdisk/fix-huge-blob-keeper-log-cutting branch May 17, 2024 11:24
MrLolthe1st pushed a commit to MrLolthe1st/ydb that referenced this pull request May 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants