Skip to content

Conversation

@dahbka-lis
Copy link
Member

@dahbka-lis dahbka-lis commented Oct 21, 2025

Changelog entry

...

Changelog category

  • Not for changelog (changelog entry is not required)

Description for reviewers

Support primitive and parametric types from here, add tests for each data type.

...

@dahbka-lis dahbka-lis requested a review from a team as a code owner October 21, 2025 17:23
@dahbka-lis dahbka-lis requested a review from Copilot October 21, 2025 17:23
@github-actions
Copy link

github-actions bot commented Oct 21, 2025

🟢 2025-10-23 13:08:14 UTC The validation of the Pull Request description is successful.

Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR prepares infrastructure for implementing a new public mapping between MiniKQL and Arrow types. The changes focus on refactoring test utilities and expanding type conversion coverage to support comprehensive testing of the MiniKQL-to-Arrow type mapping.

Key Changes:

  • Moved IsArrowCompatible from test namespace to public API
  • Enhanced test data generation with support for additional data types (Decimal, timezone types, string variants, Uuid)
  • Added comprehensive unit tests for individual data type conversions
  • Modified timezone representation in Arrow from ID (uint16) to IANA name (string)

Reviewed Changes

Copilot reviewed 3 out of 5 changed files in this pull request and generated 2 comments.

File Description
kqp_result_set_arrow_ut.cpp Expanded test coverage with new data types, added individual type conversion tests, and updated helper functions for timezone handling
kqp_result_set_arrow.h Moved IsArrowCompatible declaration from NTestUtils namespace to public API
kqp_result_set_arrow.cpp Relocated IsArrowCompatible implementation, changed timezone field from uint16 ID to UTF8 string, and updated singular type handling

Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.

@github-actions
Copy link

github-actions bot commented Oct 21, 2025

2025-10-21 17:26:20 UTC Pre-commit check linux-x86_64-relwithdebinfo for 6599d91 has started.
2025-10-21 17:26:27 UTC Artifacts will be uploaded here
2025-10-21 17:30:02 UTC ya make is running...
🟡 2025-10-21 19:06:59 UTC Some tests failed, follow the links below. Going to retry failed tests...

Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
39578 36765 0 10 2770 33

2025-10-21 19:07:10 UTC ya make is running... (failed tests rerun, try 2)
🟡 2025-10-21 19:25:45 UTC Some tests failed, follow the links below. Going to retry failed tests...

Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
654 (only retried tests) 629 0 3 0 22

2025-10-21 19:25:48 UTC ya make is running... (failed tests rerun, try 3)
🔴 2025-10-21 19:41:48 UTC Some tests failed, follow the links below.

Ya make output | Test bloat | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
548 (only retried tests) 526 0 3 0 19

🟢 2025-10-21 19:41:51 UTC Build successful.
🟢 2025-10-21 19:42:10 UTC ydbd size 2.3 GiB changed* by -2.9 KiB, which is <= 0 Bytes vs main: OK

ydbd size dash main: cb4d6e9 merge: 6599d91 diff diff %
ydbd size 2 428 280 960 Bytes 2 428 277 968 Bytes -2.9 KiB -0.000%
ydbd stripped size 516 640 520 Bytes 516 639 816 Bytes -704 Bytes -0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@github-actions
Copy link

github-actions bot commented Oct 21, 2025

2025-10-21 17:27:19 UTC Pre-commit check linux-x86_64-release-asan for 6599d91 has started.
2025-10-21 17:27:53 UTC Artifacts will be uploaded here
2025-10-21 17:31:59 UTC ya make is running...
🟡 2025-10-21 19:31:38 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
16329 15875 0 191 248 15

🟢 2025-10-21 19:31:43 UTC Build successful.
🟢 2025-10-21 19:32:06 UTC ydbd size 3.8 GiB changed* by -12.9 KiB, which is <= 0 Bytes vs main: OK

ydbd size dash main: cb4d6e9 merge: 6599d91 diff diff %
ydbd size 4 040 424 176 Bytes 4 040 410 992 Bytes -12.9 KiB -0.000%
ydbd stripped size 1 501 087 584 Bytes 1 501 079 968 Bytes -7.4 KiB -0.001%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@github-actions
Copy link

github-actions bot commented Oct 22, 2025

2025-10-22 14:36:54 UTC Pre-commit check linux-x86_64-relwithdebinfo for ef7d35d has started.
2025-10-22 14:37:12 UTC Artifacts will be uploaded here
2025-10-22 14:40:58 UTC ya make is running...
🟡 2025-10-22 16:57:20 UTC Some tests failed, follow the links below. Going to retry failed tests...

Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
39616 36829 0 4 2755 28

2025-10-22 16:57:31 UTC ya make is running... (failed tests rerun, try 2)
🟡 2025-10-22 17:17:54 UTC Some tests failed, follow the links below. Going to retry failed tests...

Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
488 (only retried tests) 457 0 1 0 30

2025-10-22 17:17:57 UTC ya make is running... (failed tests rerun, try 3)
🟢 2025-10-22 17:32:49 UTC Tests successful.

Ya make output | Test bloat | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
426 (only retried tests) 407 0 0 0 19

🟢 2025-10-22 17:32:52 UTC Build successful.
🟢 2025-10-22 17:33:10 UTC ydbd size 2.3 GiB changed* by +240 Bytes, which is < 100.0 KiB vs main: OK

ydbd size dash main: db5bb78 merge: ef7d35d diff diff %
ydbd size 2 431 510 816 Bytes 2 431 511 056 Bytes +240 Bytes +0.000%
ydbd stripped size 517 175 016 Bytes 517 175 016 Bytes 0 Bytes 0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@github-actions
Copy link

github-actions bot commented Oct 22, 2025

2025-10-22 14:50:55 UTC Pre-commit check linux-x86_64-release-asan for ef7d35d has started.
2025-10-22 14:51:27 UTC Artifacts will be uploaded here
2025-10-22 14:55:59 UTC ya make is running...
🟡 2025-10-22 17:46:39 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
16355 15834 0 218 286 17

🟢 2025-10-22 17:46:45 UTC Build successful.
🟢 2025-10-22 17:47:10 UTC ydbd size 3.8 GiB changed* by -13.2 KiB, which is <= 0 Bytes vs main: OK

ydbd size dash main: 3e0eb9b merge: ef7d35d diff diff %
ydbd size 4 045 761 120 Bytes 4 045 747 640 Bytes -13.2 KiB -0.000%
ydbd stripped size 1 502 756 672 Bytes 1 502 752 768 Bytes -3.8 KiB -0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@github-actions
Copy link

github-actions bot commented Oct 23, 2025

2025-10-23 09:34:41 UTC Pre-commit check linux-x86_64-relwithdebinfo for 79e3ee3 has started.
2025-10-23 09:34:57 UTC Artifacts will be uploaded here
2025-10-23 09:38:32 UTC ya make is running...
🟡 2025-10-23 11:13:39 UTC Some tests failed, follow the links below. Going to retry failed tests...

Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
39652 36858 0 6 2757 31

2025-10-23 11:13:54 UTC ya make is running... (failed tests rerun, try 2)
🟢 2025-10-23 11:34:47 UTC Tests successful.

Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
658 (only retried tests) 633 0 0 0 25

🟢 2025-10-23 11:34:50 UTC Build successful.
🟢 2025-10-23 11:35:07 UTC ydbd size 2.3 GiB changed* by +7.0 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: 6c24f52 merge: 79e3ee3 diff diff %
ydbd size 2 436 393 488 Bytes 2 436 400 624 Bytes +7.0 KiB +0.000%
ydbd stripped size 517 948 808 Bytes 517 949 832 Bytes +1.0 KiB +0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@github-actions
Copy link

github-actions bot commented Oct 23, 2025

2025-10-23 09:35:29 UTC Pre-commit check linux-x86_64-release-asan for 79e3ee3 has started.
2025-10-23 09:35:44 UTC Artifacts will be uploaded here
2025-10-23 09:39:33 UTC ya make is running...
🟡 2025-10-23 11:47:51 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
16397 15858 0 220 303 16

🟢 2025-10-23 11:47:56 UTC Build successful.
🟢 2025-10-23 11:48:20 UTC ydbd size 3.8 GiB changed* by +14.4 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: 6c24f52 merge: 79e3ee3 diff diff %
ydbd size 4 053 821 448 Bytes 4 053 836 160 Bytes +14.4 KiB +0.000%
ydbd stripped size 1 505 358 464 Bytes 1 505 362 624 Bytes +4.1 KiB +0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@github-actions
Copy link

github-actions bot commented Oct 23, 2025

2025-10-23 13:04:22 UTC Pre-commit check linux-x86_64-release-asan for da89c53 has started.
2025-10-23 13:04:36 UTC Artifacts will be uploaded here
2025-10-23 13:07:27 UTC Check cancelled

@github-actions
Copy link

github-actions bot commented Oct 23, 2025

2025-10-23 13:04:23 UTC Pre-commit check linux-x86_64-relwithdebinfo for da89c53 has started.
2025-10-23 13:04:38 UTC Artifacts will be uploaded here
2025-10-23 13:07:27 UTC Check cancelled

@dahbka-lis dahbka-lis changed the title Preparing to impl a new public mapping MKQL <-> Arrow Impl DataType public mapping from MKQL to Arrow Oct 23, 2025
@dahbka-lis dahbka-lis requested a review from Copilot October 23, 2025 13:04
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

Copilot reviewed 4 out of 6 changed files in this pull request and generated 2 comments.


Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.

@github-actions
Copy link

github-actions bot commented Oct 23, 2025

2025-10-23 13:08:52 UTC Pre-commit check linux-x86_64-release-asan for f209b85 has started.
2025-10-23 13:09:07 UTC Artifacts will be uploaded here
2025-10-23 13:12:47 UTC ya make is running...
🟡 2025-10-23 15:18:26 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
16391 15923 0 218 235 15

🟢 2025-10-23 15:18:32 UTC Build successful.
🟢 2025-10-23 15:18:53 UTC ydbd size 3.8 GiB changed* by +59.5 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: 74cf4c1 merge: f209b85 diff diff %
ydbd size 4 053 820 208 Bytes 4 053 881 112 Bytes +59.5 KiB +0.002%
ydbd stripped size 1 505 358 464 Bytes 1 505 385 952 Bytes +26.8 KiB +0.002%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@github-actions
Copy link

github-actions bot commented Oct 23, 2025

2025-10-23 13:08:53 UTC Pre-commit check linux-x86_64-relwithdebinfo for f209b85 has started.
2025-10-23 13:09:07 UTC Artifacts will be uploaded here
2025-10-23 13:12:44 UTC ya make is running...
🟡 2025-10-23 14:49:00 UTC Some tests failed, follow the links below. Going to retry failed tests...

Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
39648 36841 0 5 2771 31

2025-10-23 14:49:09 UTC ya make is running... (failed tests rerun, try 2)
🟢 2025-10-23 15:11:22 UTC Tests successful.

Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
874 (only retried tests) 852 0 0 0 22

🟢 2025-10-23 15:11:25 UTC Build successful.
🟢 2025-10-23 15:11:43 UTC ydbd size 2.3 GiB changed* by +18.6 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: 74cf4c1 merge: f209b85 diff diff %
ydbd size 2 436 392 128 Bytes 2 436 411 224 Bytes +18.6 KiB +0.001%
ydbd stripped size 517 948 936 Bytes 517 952 328 Bytes +3.3 KiB +0.001%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

return holderFactory.CreateVariantHolder(value.Release(), variantIndex);
}
default:
default: {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ты где удалял default опцию, может и здесь удалить?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ты где удалял default опцию, может и здесь удалить?

Я старался пока сильно не трогать код nested типов, в следующем PR посмотрю

@dahbka-lis dahbka-lis merged commit 890dd19 into ydb-platform:main Oct 24, 2025
12 checks passed
dahbka-lis added a commit to dahbka-lis/ydb that referenced this pull request Nov 18, 2025
qyryq pushed a commit to qyryq/ydb that referenced this pull request Nov 24, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Support data types from public mapping YQL to Arrow

2 participants