Skip to content

Conversation

@neyrox
Copy link
Contributor

@neyrox neyrox commented Sep 11, 2025

Changelog entry

Write stats for Column Store even in NoTx mode. Column shards were not reporting table access statistics when queries were executed in immediate transaction mode (all DDL and queries without BEGIN ... COMMIT).

#22446

Changelog category

  • Bugfix

Description for reviewers

Test also changed to reflect differences between ROW and COLUMN stores

@neyrox neyrox requested review from a team as code owners September 11, 2025 15:17
@github-actions
Copy link

github-actions bot commented Sep 11, 2025

2025-09-11 15:19:08 UTC Pre-commit check linux-x86_64-relwithdebinfo for 03c71ee has started.
2025-09-11 15:19:36 UTC Artifacts will be uploaded here
2025-09-11 15:23:39 UTC ya make is running...
2025-09-11 16:09:01 UTC Check cancelled

@github-actions
Copy link

github-actions bot commented Sep 11, 2025

2025-09-11 15:19:26 UTC Pre-commit check linux-x86_64-release-asan for 03c71ee has started.
2025-09-11 15:20:14 UTC Artifacts will be uploaded here
2025-09-11 15:25:09 UTC ya make is running...
2025-09-11 16:08:57 UTC Check cancelled

@github-actions
Copy link

github-actions bot commented Sep 11, 2025

🟢 2025-09-11 15:54:40 UTC The validation of the Pull Request description is successful.

@github-actions github-actions bot added bugfix and removed bugfix labels Sep 11, 2025
@dorooleg dorooleg requested a review from Copilot September 11, 2025 15:42
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR fixes a bug where write statistics were not being properly recorded for Column Store operations in NoTx mode by adding shard ID tracking and statistics collection.

  • Adds shard ID parameter to AddTableAccessStatsToTxStats function
  • Ensures write statistics are collected for both NoTx and transaction modes in Column Store
  • Updates test expectations to account for differences between ROW and COLUMN store statistics

Reviewed Changes

Copilot reviewed 4 out of 4 changed files in this pull request and generated no comments.

File Description
ydb/core/tx/columnshard/blobs_action/transaction/tx_blobs_written.cpp Adds shard ID parameter to statistics calls for both NoTx and transaction write modes
ydb/core/tx/columnshard/blobs_action/common/statistics.h Updates function signature to include shard ID parameter
ydb/core/tx/columnshard/blobs_action/common/statistics.cpp Implements shard statistics collection with the new shard ID parameter
ydb/core/kqp/ut/query/kqp_stats_ut.cpp Updates test assertions to handle different byte counts and partition counts between ROW and COLUMN stores

Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.

@github-actions github-actions bot added bugfix and removed bugfix labels Sep 11, 2025
@neyrox neyrox marked this pull request as draft September 11, 2025 15:54
@neyrox neyrox marked this pull request as ready for review September 11, 2025 16:10
@github-actions
Copy link

github-actions bot commented Sep 11, 2025

2025-09-11 16:11:31 UTC Pre-commit check linux-x86_64-relwithdebinfo for 015b231 has started.
2025-09-11 16:11:47 UTC Artifacts will be uploaded here
2025-09-11 16:15:10 UTC ya make is running...
🟡 2025-09-11 17:49:54 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
30491 29091 0 3 1369 28

2025-09-11 17:53:31 UTC ya make is running... (failed tests rerun, try 2)
🟢 2025-09-11 18:24:25 UTC Tests successful.

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
232 (only retried tests) 212 0 0 0 20

🟢 2025-09-11 18:24:33 UTC Build successful.
🟠 2025-09-11 18:30:56 UTC Unmuted 1 tests
🟢 2025-09-11 18:31:11 UTC ydbd size 2.3 GiB changed* by +6.4 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: 8a3cc7a merge: 015b231 diff diff %
ydbd size 2 468 916 968 Bytes 2 468 923 496 Bytes +6.4 KiB +0.000%
ydbd stripped size 515 859 016 Bytes 515 859 720 Bytes +704 Bytes +0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@github-actions
Copy link

github-actions bot commented Sep 11, 2025

2025-09-11 16:11:53 UTC Pre-commit check linux-x86_64-release-asan for 015b231 has started.
2025-09-11 16:12:07 UTC Artifacts will be uploaded here
2025-09-11 16:15:40 UTC ya make is running...
🟡 2025-09-11 18:31:59 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
15063 14629 0 137 265 32

🟢 2025-09-11 18:33:29 UTC Build successful.
🟢 2025-09-11 18:33:52 UTC ydbd size 4.0 GiB changed* by -3.9 KiB, which is <= 0 Bytes vs main: OK

ydbd size dash main: 4822a3d merge: 015b231 diff diff %
ydbd size 4 318 803 144 Bytes 4 318 799 104 Bytes -3.9 KiB -0.000%
ydbd stripped size 1 493 361 112 Bytes 1 493 361 880 Bytes +768 Bytes +0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@dorooleg dorooleg requested a review from nikvas0 September 11, 2025 17:59
@neyrox neyrox requested a review from Vladilen September 12, 2025 06:53
Vladilen
Vladilen previously approved these changes Sep 12, 2025
nikvas0
nikvas0 previously approved these changes Sep 12, 2025
@neyrox neyrox dismissed stale reviews from nikvas0 and Vladilen via bd3cf1b September 12, 2025 14:52
@github-actions
Copy link

github-actions bot commented Sep 12, 2025

2025-09-12 14:53:46 UTC Pre-commit check linux-x86_64-release-asan for 490f1b0 has started.
2025-09-12 14:53:51 UTC Artifacts will be uploaded here
2025-09-12 14:57:15 UTC ya make is running...
🟡 2025-09-12 16:55:10 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
15078 14655 0 134 263 26

🟢 2025-09-12 16:56:44 UTC Build successful.
🟢 2025-09-12 16:57:06 UTC ydbd size 4.0 GiB changed* by +52.4 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: e421060 merge: 490f1b0 diff diff %
ydbd size 4 321 070 776 Bytes 4 321 124 448 Bytes +52.4 KiB +0.001%
ydbd stripped size 1 494 449 624 Bytes 1 494 469 464 Bytes +19.4 KiB +0.001%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@github-actions
Copy link

github-actions bot commented Sep 12, 2025

2025-09-12 14:53:54 UTC Pre-commit check linux-x86_64-relwithdebinfo for 490f1b0 has started.
2025-09-12 14:54:08 UTC Artifacts will be uploaded here
2025-09-12 14:57:38 UTC ya make is running...
🟡 2025-09-12 16:19:26 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
30513 29112 0 3 1370 28

2025-09-12 16:22:13 UTC ya make is running... (failed tests rerun, try 2)
🟢 2025-09-12 16:30:06 UTC Tests successful.

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
378 (only retried tests) 360 0 0 0 18

🟢 2025-09-12 16:30:15 UTC Build successful.
🟠 2025-09-12 16:31:57 UTC Unmuted 1 tests
🟢 2025-09-12 16:32:12 UTC ydbd size 2.3 GiB changed* by +24.2 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: e421060 merge: 490f1b0 diff diff %
ydbd size 2 469 796 400 Bytes 2 469 821 192 Bytes +24.2 KiB +0.001%
ydbd stripped size 516 037 928 Bytes 516 043 112 Bytes +5.1 KiB +0.001%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@Vladilen Vladilen requested a review from nikvas0 September 12, 2025 15:36
@neyrox neyrox requested a review from Vladilen September 15, 2025 07:05
@neyrox neyrox enabled auto-merge (squash) September 15, 2025 07:05
Vladilen
Vladilen previously approved these changes Sep 15, 2025
@github-actions
Copy link

github-actions bot commented Sep 15, 2025

2025-09-15 10:27:46 UTC Pre-commit check linux-x86_64-release-asan for 4fca2d7 has started.
2025-09-15 10:28:00 UTC Artifacts will be uploaded here
2025-09-15 10:31:21 UTC ya make is running...
🟡 2025-09-15 12:31:50 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
15133 14673 0 134 294 32

🟢 2025-09-15 12:33:10 UTC Build successful.
🟢 2025-09-15 12:33:34 UTC ydbd size 4.0 GiB changed* by +3.2 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: 0896bce merge: 4fca2d7 diff diff %
ydbd size 4 327 840 640 Bytes 4 327 843 872 Bytes +3.2 KiB +0.000%
ydbd stripped size 1 496 180 984 Bytes 1 496 181 880 Bytes +896 Bytes +0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@github-actions
Copy link

github-actions bot commented Sep 15, 2025

2025-09-15 10:27:47 UTC Pre-commit check linux-x86_64-relwithdebinfo for 4fca2d7 has started.
2025-09-15 10:28:02 UTC Artifacts will be uploaded here
2025-09-15 10:31:29 UTC ya make is running...
🟡 2025-09-15 11:47:11 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
30608 29097 0 2 1477 32

2025-09-15 11:50:16 UTC ya make is running... (failed tests rerun, try 2)
🟢 2025-09-15 12:04:27 UTC Tests successful.

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
398 (only retried tests) 380 0 0 0 18

🟢 2025-09-15 12:04:36 UTC Build successful.
🟠 2025-09-15 12:12:57 UTC Unmuted 1 tests
🟢 2025-09-15 12:13:13 UTC ydbd size 2.3 GiB changed* by +1.7 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: 0896bce merge: 4fca2d7 diff diff %
ydbd size 2 473 365 576 Bytes 2 473 367 336 Bytes +1.7 KiB +0.000%
ydbd stripped size 516 609 896 Bytes 516 610 088 Bytes +192 Bytes +0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@neyrox neyrox requested a review from Vladilen September 16, 2025 08:58
@neyrox neyrox merged commit 26e567f into ydb-platform:main Sep 16, 2025
12 checks passed
@liruoko liruoko added the changelog/f25-3 PR участвует в списке изменений label Nov 19, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bugfix changelog/f25-3 PR участвует в списке изменений

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants