Skip to content

Conversation

@Vladilen
Copy link
Collaborator

Changelog entry

...

Changelog category

  • Not for changelog (changelog entry is not required)

Description for reviewers

...

@github-actions
Copy link

github-actions bot commented Nov 17, 2025

2025-11-17 11:20:00 UTC Pre-commit check linux-x86_64-release-asan for 3664ed6 has started.
2025-11-17 11:20:04 UTC Artifacts will be uploaded here
2025-11-17 11:21:37 UTC ya make is running...
🟡 2025-11-17 13:28:51 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
17969 17473 0 233 235 28

🟢 2025-11-17 13:29:00 UTC Build successful.
🟢 2025-11-17 13:29:29 UTC ydbd size 3.9 GiB changed* by -22.5 KiB, which is <= 0 Bytes vs main: OK

ydbd size dash main: 76be1f7 merge: 3664ed6 diff diff %
ydbd size 4 137 160 096 Bytes 4 137 137 056 Bytes -22.5 KiB -0.001%
ydbd stripped size 1 523 011 584 Bytes 1 523 000 128 Bytes -11.2 KiB -0.001%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@github-actions
Copy link

github-actions bot commented Nov 17, 2025

2025-11-17 11:21:18 UTC Pre-commit check linux-x86_64-relwithdebinfo for 3664ed6 has started.
2025-11-17 11:21:22 UTC Artifacts will be uploaded here
2025-11-17 11:22:57 UTC ya make is running...
🟡 2025-11-17 13:11:46 UTC Some tests failed, follow the links below. Going to retry failed tests...

Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
41671 38802 0 5 2839 25

2025-11-17 13:12:01 UTC ya make is running... (failed tests rerun, try 2)
🟢 2025-11-17 13:23:20 UTC Tests successful.

Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
64 (only retried tests) 48 0 0 0 16

🟢 2025-11-17 13:23:28 UTC Build successful.
🟢 2025-11-17 13:23:50 UTC ydbd size 2.3 GiB changed* by +2.8 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: 32e7b34 merge: 3664ed6 diff diff %
ydbd size 2 480 199 072 Bytes 2 480 201 912 Bytes +2.8 KiB +0.000%
ydbd stripped size 520 976 024 Bytes 520 976 792 Bytes +768 Bytes +0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@github-actions
Copy link

🟢 2025-11-17 11:22:57 UTC The validation of the Pull Request description is successful.

@github-actions
Copy link

github-actions bot commented Nov 17, 2025

2025-11-17 15:31:27 UTC Pre-commit check linux-x86_64-relwithdebinfo for aaa6f1b has started.
2025-11-17 15:31:30 UTC Artifacts will be uploaded here
2025-11-17 15:32:46 UTC ya make is running...
2025-11-17 15:34:37 UTC Check cancelled

@github-actions
Copy link

github-actions bot commented Nov 17, 2025

2025-11-17 15:32:41 UTC Pre-commit check linux-x86_64-release-asan for aaa6f1b has started.
2025-11-17 15:33:00 UTC Artifacts will be uploaded here
2025-11-17 15:34:37 UTC Check cancelled

@github-actions
Copy link

github-actions bot commented Nov 17, 2025

2025-11-17 15:37:04 UTC Pre-commit check linux-x86_64-relwithdebinfo for 4aac8f2 has started.
2025-11-17 15:37:21 UTC Artifacts will be uploaded here
2025-11-17 15:39:27 UTC ya make is running...
🟡 2025-11-17 17:12:23 UTC Some tests failed, follow the links below. Going to retry failed tests...

Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
41202 38328 0 3 2841 30

2025-11-17 17:12:36 UTC ya make is running... (failed tests rerun, try 2)
🟢 2025-11-17 17:27:33 UTC Tests successful.

Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
72 (only retried tests) 55 0 0 0 17

🟢 2025-11-17 17:27:39 UTC Build successful.
🟢 2025-11-17 17:27:58 UTC ydbd size 2.3 GiB changed* by +1.0 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: 57cd43a merge: 4aac8f2 diff diff %
ydbd size 2 480 438 952 Bytes 2 480 440 008 Bytes +1.0 KiB +0.000%
ydbd stripped size 521 010 840 Bytes 521 015 064 Bytes +4.1 KiB +0.001%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@github-actions
Copy link

github-actions bot commented Nov 17, 2025

2025-11-17 15:37:18 UTC Pre-commit check linux-x86_64-release-asan for 4aac8f2 has started.
2025-11-17 15:37:35 UTC Artifacts will be uploaded here
2025-11-17 15:39:40 UTC ya make is running...
🟡 2025-11-17 17:41:29 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
17704 17329 0 155 194 26

🟢 2025-11-17 17:41:39 UTC Build successful.
🟢 2025-11-17 17:42:07 UTC ydbd size 3.9 GiB changed* by -8.6 KiB, which is <= 0 Bytes vs main: OK

ydbd size dash main: 57cd43a merge: 4aac8f2 diff diff %
ydbd size 4 137 476 200 Bytes 4 137 467 368 Bytes -8.6 KiB -0.000%
ydbd stripped size 1 523 093 488 Bytes 1 523 089 520 Bytes -3.9 KiB -0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@Vladilen Vladilen marked this pull request as ready for review November 17, 2025 15:42
@Vladilen Vladilen requested review from a team as code owners November 17, 2025 15:42
@Vladilen Vladilen requested review from Copilot and dorooleg November 17, 2025 15:42
@Vladilen Vladilen marked this pull request as draft November 17, 2025 15:43
Copilot finished reviewing on behalf of Vladilen November 17, 2025 15:47
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR removes double BinaryJson parsing by introducing a direct serialization method that accepts TEntryCursor objects. Previously, code that extracted values from BinaryJson would convert them to JSON text and re-parse them back into BinaryJson, which was inefficient.

Key Changes:

  • Added new SerializeToBinaryJson(const TEntryCursor&) overload that directly serializes cursor values without JSON text intermediation
  • Updated json_extractors.cpp to use the new direct serialization API for scalar values
  • Added comprehensive test coverage for the new extraction functionality

Reviewed Changes

Copilot reviewed 6 out of 6 changed files in this pull request and generated 4 comments.

Show a summary per file
File Description
yql/essentials/types/binary_json/write.h Declares new SerializeToBinaryJson overload accepting TEntryCursor and adds required read.h include
yql/essentials/types/binary_json/write.cpp Implements SerializeEntryCursorToBinaryJson helper and public SerializeToBinaryJson overload for direct cursor serialization
yql/essentials/types/binary_json/ut/ya.make Adds new test file extract_ut.cpp to the build
yql/essentials/types/binary_json/ut/extract_ut.cpp Provides comprehensive test coverage for extracting and re-serializing BinaryJson values
ydb/core/formats/arrow/accessor/sub_columns/json_extractors.h Changes parameter to const reference for better API design
ydb/core/formats/arrow/accessor/sub_columns/json_extractors.cpp Replaces manual JSON text serialization with new direct API for scalar values

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

@github-actions
Copy link

github-actions bot commented Nov 18, 2025

2025-11-18 09:03:16 UTC Pre-commit check linux-x86_64-relwithdebinfo for f3ea976 has started.
2025-11-18 09:03:33 UTC Artifacts will be uploaded here
2025-11-18 09:05:39 UTC ya make is running...
2025-11-18 09:13:57 UTC Check cancelled

@github-actions
Copy link

github-actions bot commented Nov 18, 2025

2025-11-18 09:03:24 UTC Pre-commit check linux-x86_64-release-asan for f3ea976 has started.
2025-11-18 09:03:42 UTC Artifacts will be uploaded here
2025-11-18 09:05:46 UTC ya make is running...
2025-11-18 09:13:58 UTC Check cancelled

@github-actions
Copy link

github-actions bot commented Nov 18, 2025

2025-11-18 09:14:26 UTC Pre-commit check linux-x86_64-relwithdebinfo for a36cf7a has started.
2025-11-18 09:14:37 UTC Artifacts will be uploaded here
2025-11-18 09:15:54 UTC ya make is running...
🟡 2025-11-18 11:19:51 UTC Some tests failed, follow the links below. Going to retry failed tests...

Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
41211 38330 0 6 2843 32

2025-11-18 11:20:04 UTC ya make is running... (failed tests rerun, try 2)
🟢 2025-11-18 11:35:23 UTC Tests successful.

Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
84 (only retried tests) 67 0 0 0 17

🟢 2025-11-18 11:35:30 UTC Build successful.
🟢 2025-11-18 11:35:51 UTC ydbd size 2.3 GiB changed* by -2.9 KiB, which is <= 0 Bytes vs main: OK

ydbd size dash main: c831b33 merge: a36cf7a diff diff %
ydbd size 2 445 184 984 Bytes 2 445 181 968 Bytes -2.9 KiB -0.000%
ydbd stripped size 519 906 200 Bytes 519 906 328 Bytes +128 Bytes +0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@github-actions
Copy link

github-actions bot commented Nov 18, 2025

2025-11-18 09:15:23 UTC Pre-commit check linux-x86_64-release-asan for a36cf7a has started.
2025-11-18 09:15:40 UTC Artifacts will be uploaded here
2025-11-18 09:17:44 UTC ya make is running...
🟡 2025-11-18 11:11:24 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
15329 15159 0 89 65 16

🟢 2025-11-18 11:11:35 UTC Build successful.
🟢 2025-11-18 11:12:01 UTC ydbd size 3.8 GiB changed* by -8.5 KiB, which is <= 0 Bytes vs main: OK

ydbd size dash main: c831b33 merge: a36cf7a diff diff %
ydbd size 4 093 748 024 Bytes 4 093 739 272 Bytes -8.5 KiB -0.000%
ydbd stripped size 1 519 863 216 Bytes 1 519 859 312 Bytes -3.8 KiB -0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@github-actions
Copy link

github-actions bot commented Nov 19, 2025

2025-11-19 09:02:33 UTC Pre-commit check linux-x86_64-relwithdebinfo for 40df502 has started.
2025-11-19 09:02:51 UTC Artifacts will be uploaded here
2025-11-19 09:04:59 UTC ya make is running...
2025-11-19 09:55:26 UTC Check cancelled

@github-actions
Copy link

github-actions bot commented Nov 19, 2025

2025-11-19 09:02:33 UTC Pre-commit check linux-x86_64-release-asan for 40df502 has started.
2025-11-19 09:02:51 UTC Artifacts will be uploaded here
2025-11-19 09:04:55 UTC ya make is running...
2025-11-19 09:55:26 UTC Check cancelled

@github-actions
Copy link

github-actions bot commented Nov 19, 2025

2025-11-19 09:57:17 UTC Pre-commit check linux-x86_64-release-asan for 079b2de has started.
2025-11-19 09:57:33 UTC Artifacts will be uploaded here
2025-11-19 09:59:36 UTC ya make is running...
🟡 2025-11-19 11:12:47 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
14316 14135 0 147 20 14

🟢 2025-11-19 11:12:59 UTC Build successful.
🟢 2025-11-19 11:13:26 UTC ydbd size 3.8 GiB changed* by +50.2 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: b76d011 merge: 079b2de diff diff %
ydbd size 4 096 090 136 Bytes 4 096 141 592 Bytes +50.2 KiB +0.001%
ydbd stripped size 1 520 479 184 Bytes 1 520 502 832 Bytes +23.1 KiB +0.002%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@github-actions
Copy link

github-actions bot commented Nov 19, 2025

2025-11-19 09:57:35 UTC Pre-commit check linux-x86_64-relwithdebinfo for 079b2de has started.
2025-11-19 09:57:53 UTC Artifacts will be uploaded here
2025-11-19 10:00:08 UTC ya make is running...
🟡 2025-11-19 11:33:03 UTC Some tests failed, follow the links below. Going to retry failed tests...

Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
41246 38379 0 1 2838 28

2025-11-19 11:33:19 UTC ya make is running... (failed tests rerun, try 2)
🟡 2025-11-19 11:48:58 UTC Some tests failed, follow the links below. Going to retry failed tests...

Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
58 (only retried tests) 42 0 1 0 15

2025-11-19 11:49:06 UTC ya make is running... (failed tests rerun, try 3)
🟢 2025-11-19 11:57:01 UTC Tests successful.

Ya make output | Test bloat | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
32 (only retried tests) 18 0 0 0 14

🟢 2025-11-19 11:57:09 UTC Build successful.
🟢 2025-11-19 11:57:32 UTC ydbd size 2.3 GiB changed* by +17.6 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: b76d011 merge: 079b2de diff diff %
ydbd size 2 446 746 216 Bytes 2 446 764 256 Bytes +17.6 KiB +0.001%
ydbd stripped size 520 145 112 Bytes 520 146 584 Bytes +1.4 KiB +0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@Vladilen Vladilen marked this pull request as ready for review November 21, 2025 11:13
@github-actions
Copy link

github-actions bot commented Nov 21, 2025

2025-11-21 11:13:30 UTC Pre-commit check linux-x86_64-release-asan for 8dc607e has started.
2025-11-21 11:14:10 UTC Artifacts will be uploaded here
2025-11-21 11:16:09 UTC ya make is running...
🟡 2025-11-21 12:45:21 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
12486 12360 0 100 14 12

🟢 2025-11-21 12:45:29 UTC Build successful.
🟢 2025-11-21 12:45:53 UTC ydbd size 3.8 GiB changed* by -302.5 KiB, which is <= 0 Bytes vs main: OK

ydbd size dash main: b03510c merge: 8dc607e diff diff %
ydbd size 4 109 327 048 Bytes 4 109 017 248 Bytes -302.5 KiB -0.008%
ydbd stripped size 1 527 436 208 Bytes 1 527 298 064 Bytes -134.9 KiB -0.009%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@Vladilen Vladilen requested review from Copilot and removed request for a team November 21, 2025 11:13
@github-actions
Copy link

github-actions bot commented Nov 21, 2025

2025-11-21 11:14:08 UTC Pre-commit check linux-x86_64-relwithdebinfo for 8dc607e has started.
2025-11-21 11:14:24 UTC Artifacts will be uploaded here
2025-11-21 11:16:30 UTC ya make is running...
🟡 2025-11-21 13:02:46 UTC Some tests failed, follow the links below. Going to retry failed tests...

Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
39436 36559 0 3 2839 35

2025-11-21 13:02:58 UTC ya make is running... (failed tests rerun, try 2)
🟢 2025-11-21 13:16:03 UTC Tests successful.

Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
74 (only retried tests) 56 0 0 0 18

🟢 2025-11-21 13:16:09 UTC Build successful.
🟢 2025-11-21 13:16:31 UTC ydbd size 2.3 GiB changed* by -168.4 KiB, which is <= 0 Bytes vs main: OK

ydbd size dash main: b03510c merge: 8dc607e diff diff %
ydbd size 2 454 692 296 Bytes 2 454 519 824 Bytes -168.4 KiB -0.007%
ydbd stripped size 523 123 768 Bytes 523 087 768 Bytes -35.2 KiB -0.007%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copilot finished reviewing on behalf of Vladilen November 21, 2025 11:16
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

Copilot reviewed 2 out of 2 changed files in this pull request and generated no new comments.


💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

@Vladilen Vladilen merged commit a976f29 into ydb-platform:main Nov 21, 2025
16 checks passed
Vladilen added a commit to Vladilen/ydb that referenced this pull request Dec 5, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants