Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Completion of the transaction #4407

Merged
merged 10 commits into from
May 22, 2024

Conversation

Alek5andr-Kotov
Copy link
Collaborator

Changelog entry

Added the TEvDeletePartition, TEvDeletePartitionDone and TEvTransactionCompleted messages. Upon completion of the transaction, the PQ tablet sends TEvDeletePartition to the auxiliary partitions and waits for TEvDeletePartitionDone from them

Changelog category

  • Not for changelog (changelog entry is not required)

Additional information

...

Copy link

github-actions bot commented May 8, 2024

2024-05-08 16:10:06 UTC Pre-commit check for 852f11e has started.
2024-05-08 16:10:09 UTC Build linux-x86_64-release-clang14 is running...
🟢 2024-05-08 16:14:19 UTC Build successful.

Copy link

github-actions bot commented May 8, 2024

2024-05-08 16:10:12 UTC Pre-commit check for 852f11e has started.
2024-05-08 16:10:15 UTC Build linux-x86_64-release-asan is running...
🟢 2024-05-08 16:15:16 UTC Build successful.
2024-05-08 16:17:00 UTC Tests are running...
🔴 2024-05-08 17:55:02 UTC Some tests failed, follow the links below.

Test history

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
9056 8992 0 19 37 8

Copy link

github-actions bot commented May 8, 2024

2024-05-08 16:10:26 UTC Pre-commit check for 852f11e has started.
2024-05-08 16:10:28 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-05-08 16:15:19 UTC Build successful.
2024-05-08 16:17:01 UTC Tests are running...
🔴 2024-05-08 17:32:42 UTC Some tests failed, follow the links below.

Test history

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
13160 11322 0 2 1828 8

alexnick88
alexnick88 previously approved these changes May 13, 2024
void TPersQueue::Handle(TEvPQ::TEvDeletePartitionDone::TPtr& ev, const TActorContext& ctx)
{
auto* event = ev->Get();
const ui64 writeId = event->Cookie;
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Return writeId in EvDeletePartitionDone response, no Cookie field required anymore.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

PartitionId is used instead of WriteId
76c2d74

Y_ABORT_UNLESS(Partitions.contains(partitionId));
const TPartitionInfo& partition = Partitions.at(partitionId);

Send(partition.Actor, new TEvents::TEvPoisonPill());
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Call die() or PassAway() in partition actor on sending EvDeletePartitionDone.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done
1b4b028


void TPartition::ScheduleNegativeReply(const TEvPQ::TEvSetClientInfo&)
{
Y_ABORT_UNLESS(false, "The supportive partition does not accept read operations");
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Y_ABORT

Copy link
Collaborator Author

@Alek5andr-Kotov Alek5andr-Kotov May 13, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed
8b94486

@@ -91,6 +91,10 @@ class TPartition : public TActorBootstrapped<TPartition> {
static const ui32 MAX_ERRORS_COUNT_TO_STORE = 10;
static const ui32 SCALE_REQUEST_REPEAT_MIN_SECONDS = 60;

enum ECookie : ui64 {
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Remove cookie.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done
76c2d74

@@ -795,6 +804,19 @@ class TPartition : public TActorBootstrapped<TPartition> {
bool ClosedInternalPartition = false;

bool IsSupportive() const;

ui64 DeletePartitionCookie = 0;
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Change to ENUM:
DELETEION_NOT_INITED
DELETION_INITED
DELETION_IN_PROCESS

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done
76c2d74

@@ -483,10 +483,12 @@ class TPersQueue : public NKeyValue::TKeyValueFlat {
void CreateSupportivePartitionActor(const TPartitionId& shadowPartitionId, const TActorContext& ctx);
NKikimrPQ::TPQTabletConfig MakeSupportivePartitionConfig() const;
void SubscribeWriteId(ui64 writeId, const TActorContext& ctx);
void UnsubscribeWriteId(ui64 writeId, const TActorContext& ctx);
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No EvDeletePartition called!

Copy link

github-actions bot commented May 13, 2024

2024-05-13 08:13:30 UTC Pre-commit check for 3b75e88 has started.
2024-05-13 08:13:33 UTC Build linux-x86_64-release-clang14 is running...
🟢 2024-05-13 08:18:25 UTC Build successful.

Copy link

github-actions bot commented May 13, 2024

2024-05-13 08:13:37 UTC Pre-commit check for 3b75e88 has started.
2024-05-13 08:13:40 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-05-13 08:19:00 UTC Build successful.
2024-05-13 08:20:51 UTC Tests are running...
🔴 2024-05-13 09:38:10 UTC Some tests failed, follow the links below.

Test history

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
13167 11323 0 5 1828 11

Copy link

github-actions bot commented May 13, 2024

2024-05-13 08:14:04 UTC Pre-commit check for 3b75e88 has started.
2024-05-13 08:14:06 UTC Build linux-x86_64-release-asan is running...
🟢 2024-05-13 08:19:35 UTC Build successful.
2024-05-13 08:21:18 UTC Tests are running...
🔴 2024-05-13 10:05:35 UTC Some tests failed, follow the links below.

Test history

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
9061 8976 0 26 51 8

Copy link

github-actions bot commented May 13, 2024

2024-05-13 11:45:04 UTC Pre-commit check for 33b0fe6 has started.
2024-05-13 11:45:05 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-05-13 11:49:59 UTC Build successful.
2024-05-13 11:51:32 UTC Tests are running...
🔴 2024-05-13 12:13:38 UTC Test run completed, no test results found for commit 76c2d74. Please check build logs.
2024-05-13 12:13:42 UTC Check cancelled

Copy link

github-actions bot commented May 13, 2024

2024-05-13 11:50:03 UTC Pre-commit check for 33b0fe6 has started.
2024-05-13 11:50:04 UTC Build linux-x86_64-release-clang14 is running...
🟢 2024-05-13 11:55:25 UTC Build successful.

Copy link

github-actions bot commented May 13, 2024

2024-05-13 11:52:16 UTC Pre-commit check for 33b0fe6 has started.
2024-05-13 11:52:17 UTC Build linux-x86_64-release-asan is running...
🟢 2024-05-13 11:57:26 UTC Build successful.
2024-05-13 11:58:59 UTC Tests are running...
🔴 2024-05-13 12:13:49 UTC Test run completed, no test results found for commit 76c2d74. Please check build logs.
2024-05-13 12:13:52 UTC Check cancelled

Copy link

github-actions bot commented May 13, 2024

2024-05-13 12:22:31 UTC Pre-commit check for 0124974 has started.
2024-05-13 12:22:32 UTC Build linux-x86_64-release-asan is running...
🟢 2024-05-13 12:24:37 UTC Build successful.
2024-05-13 12:26:11 UTC Tests are running...
🔴 2024-05-13 12:36:20 UTC Test run completed, no test results found for commit f22b220. Please check build logs.
2024-05-13 12:36:23 UTC Check cancelled

Copy link

github-actions bot commented May 13, 2024

2024-05-13 12:37:05 UTC Pre-commit check for 87b4d78 has started.
2024-05-13 12:37:07 UTC Build linux-x86_64-release-asan is running...
🟢 2024-05-13 12:39:21 UTC Build successful.
2024-05-13 12:40:58 UTC Tests are running...
🔴 2024-05-13 14:22:41 UTC Some tests failed, follow the links below.

Test history

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
9060 9009 0 17 24 10

Copy link

github-actions bot commented May 13, 2024

2024-05-13 12:40:01 UTC Pre-commit check for 87b4d78 has started.
2024-05-13 12:40:02 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-05-13 12:42:08 UTC Build successful.
2024-05-13 12:43:34 UTC Tests are running...
🔴 2024-05-13 13:56:10 UTC Some tests failed, follow the links below.

Test history

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
13164 11326 0 2 1828 8

Copy link

github-actions bot commented May 13, 2024

2024-05-13 12:40:18 UTC Pre-commit check for 87b4d78 has started.
2024-05-13 12:40:19 UTC Build linux-x86_64-release-clang14 is running...
🟢 2024-05-13 12:42:22 UTC Build successful.

Copy link

github-actions bot commented May 14, 2024

2024-05-14 18:43:28 UTC Pre-commit check for f29e3fb has started.
2024-05-14 18:43:31 UTC Build linux-x86_64-release-asan is running...
🟢 2024-05-14 18:48:52 UTC Build successful.
2024-05-14 18:50:41 UTC Tests are running...
🔴 2024-05-14 20:34:30 UTC Some tests failed, follow the links below.

Test history

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
9073 9018 0 24 24 7

Copy link

github-actions bot commented May 14, 2024

2024-05-14 18:43:30 UTC Pre-commit check for f29e3fb has started.
2024-05-14 18:43:32 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-05-14 18:48:23 UTC Build successful.
2024-05-14 18:50:15 UTC Tests are running...
🔴 2024-05-14 20:07:40 UTC Some tests failed, follow the links below.

Test history

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
13179 11316 0 10 1840 13

Copy link

github-actions bot commented May 14, 2024

2024-05-14 18:43:30 UTC Pre-commit check for f29e3fb has started.
2024-05-14 18:43:32 UTC Build linux-x86_64-release-clang14 is running...
🟢 2024-05-14 18:47:55 UTC Build successful.

Copy link

github-actions bot commented May 15, 2024

2024-05-15 07:44:09 UTC Pre-commit check for 5f91f6a has started.
2024-05-15 07:44:12 UTC Build linux-x86_64-release-asan is running...
🟢 2024-05-15 07:46:53 UTC Build successful.
2024-05-15 07:48:40 UTC Tests are running...
🔴 2024-05-15 09:30:44 UTC Some tests failed, follow the links below.

Test history

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
9070 9025 0 17 20 8

Copy link

github-actions bot commented May 15, 2024

2024-05-15 07:44:13 UTC Pre-commit check for 5f91f6a has started.
2024-05-15 07:44:15 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-05-15 07:46:47 UTC Build successful.
2024-05-15 07:48:35 UTC Tests are running...
🔴 2024-05-15 09:03:46 UTC Some tests failed, follow the links below.

Test history

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
13175 11334 0 5 1828 8

Copy link

github-actions bot commented May 15, 2024

2024-05-15 07:44:19 UTC Pre-commit check for 5f91f6a has started.
2024-05-15 07:44:21 UTC Build linux-x86_64-release-clang14 is running...
🟢 2024-05-15 07:47:00 UTC Build successful.

NPQ::AddCmdDeleteRange(request, TKeyPrefix::TypeInfo, Partition);
NPQ::AddCmdDeleteRange(request, TKeyPrefix::TypeData, Partition);
NPQ::AddCmdDeleteRange(request, TKeyPrefix::TypeTmpData, Partition);
NPQ::AddCmdDeleteRange(request, TKeyPrefix::TypeMeta, Partition);
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Remove TypeTxMeta

@Alek5andr-Kotov Alek5andr-Kotov merged commit b70900d into ydb-platform:main May 22, 2024
3 of 5 checks passed
MrLolthe1st pushed a commit to MrLolthe1st/ydb that referenced this pull request May 28, 2024
@niksaveliev niksaveliev mentioned this pull request May 29, 2024
This was referenced Jun 7, 2024
@niksaveliev niksaveliev mentioned this pull request Jun 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants