Skip to content

Library import 250710-1853 #20968

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 44 commits into from
Jul 10, 2025
Merged

Library import 250710-1853 #20968

merged 44 commits into from
Jul 10, 2025

Conversation

alexv-smirnov
Copy link
Member

PR was created by rightlib sync workflow run

robot-piglet and others added 30 commits July 9, 2025 10:41
commit_hash:d8fa10d7fba592f861e1470374c72cf22f0d5a2b
commit_hash:293866ae3430dc6a4a261f8febfc4bedcbc2176c
Update tools: test_tool, os_ya, ya_bin, os_test_tool
commit_hash:4f41b75130bef78ec002dc9b97809ed37667c48c
commit_hash:5ead30dd726387e1a8c39e57e55116ddeaac67f6
Add Y_NO_UNIQUE_ADDRESS
commit_hash:ef4b0719294a6019a0b5802769cb2a15c2dd1b64
commit_hash:a497dfe8863a864913c1d6df4b28edbe7d8e4bba
Еще идея была с таким выводом:

Invalid format character 'q' in DateTime::Format.
Allowed format characters: - %Y: year (e.g., 2023) - %m: month (e.g., 01 to 12) - %d: day of the month (e.g., 01 to 31)
More format characters available in the documentation: https://nda.ya.ru/t/NC9Huj1V7GFfJn
commit_hash:6ba063a3fe8d164b1c9d9c5f80e558c521cbaf29
commit_hash:7bb800e750c7212d6b24264725e5b294e67c529b
commit_hash:0f510cbd7d839d7f3baf830f59d746ab5e47e4cb
Fix tests jvmargs
commit_hash:80cf5083c74e04c95afbfae674bff77fec4d91f2
В этом пре переписал ноды `Wide{Top,TopSort,Sort}Blocks` с flow на stream реализацию.
Я разбил пр на два коммита: первый, это просто двигаю классы вверх вниз. Второй - сами изменения.

[Прогон тестов](https://nda.ya.ru/t/P9kfAmHr7GFmgy с понижением Runtime версии
commit_hash:0813a74aaa904b12846692c0e7504334170ea6db
add clone method
commit_hash:c96c84b95c05e307a7391742f4fca56010b24e3f
Introduce `UNION` and `INTERSECT/EXCEPT` grammar rules
for precedence. Rewrote `Build` procedure into `BuildStmt`,
`BuildUnion`, `BuildIntersection`. Added tests, modify format.

It took a lot of time trying to adapt the existing `Build` procedure.
The I noticed that the logic for `union` and `intersection` is
different, since `union` groups arguments into bundles, but
`intersection` is a strictly binary operation.
commit_hash:70008ae3c2603364b6dfbeeb189fdc7f5237433d
Removed unnecessary copying and allocations. Processor branch predictor should eat the `if` statements which emerged as a result.

* Changelog entry

Type: fix
Component: misc-server

Optimized heavy TColumnarStatistics::Update call.
commit_hash:293eeca2347e71cc3ea8fe61a2faa83211c8bd15
I missed that a query parameter key starts with
'$'.
commit_hash:1a24953b4f837da31db2201b9a9ffd0eef0c6b34
Fix
commit_hash:3ceec269bc1e9f318949493b79d1536db72d8a11
commit_hash:2c408c6ee755878a488f1591510d196d1bf5fba1
commit_hash:e7846c444dce1a91050e458886f839bf3424a5c6
- **yt/rpc-proxy: add dedicated bus server for public use**
- **yt/driver: add option for rpc-proxy default address type**
- **yt/environment: separate internal and public CA**
- **yt/environment: prefer https for rpc proxy discovery**
- **yt/test: use rpc proxy public rpc port for tls setup**

---

* Changelog entry
Type: feature
Component: misc-server

Add public RPC server for RPC proxies with own TLS certificate.

---

Pull Request resolved: ytsaurus/ytsaurus#1358

Co-authored-by: yuryalekseev <yuryalekseev@yandex-team.com>
commit_hash:6f0fbae00978dcc529c08ab4eb995f92357abbd9
```
pg:~/1/contrib/tools/yasm ya make -r --target-platform=default-freebsd-x86_64
Ok
```
commit_hash:d44f7e6e2ed31611ad352069a9289f448f29632a
commit_hash:48a12ef41d0b332787ebbb468e95eb53df3a768f
- **yt/yt/core/test_framework: update and refactor test keys**

    Present certificate are expired:

       Issuer: C = CN, ST = Some-State, O = Internet Widgits Pty Ltd
       Validity
           Not Before: Nov  1 06:59:16 2014 GMT
           Not After : Oct 29 06:59:16 2024 GMT
       Subject: C = CN, ST = Some-State, O = Internet Widgits Pty Ltd

       Issuer: C = US, O = Let's Encrypt, CN = Let's Encrypt Authority X3
       Validity
           Not Before: Feb 12 19:27:22 2018 GMT
           Not After : May 13 19:27:22 2018 GMT
       Subject: CN = cpp.manytask.org

       Issuer: O = Digital Signature Trust Co., CN = DST Root CA X3
       Validity
           Not Before: Mar 17 16:40:46 2016 GMT
           Not After : Mar 17 16:40:46 2021 GMT
       Subject: C = US, O = Let's Encrypt, CN = Let's Encrypt Authority X3

    Reuse test certificate from yt/yt/core/bus for "localhost".

       Issuer: C = RU, ST = Moscow, O = Yandex, CN = CA@localhost
       Validity
           Not Before: Jul 13 11:51:17 2023 GMT
           Not After : Jul 10 11:51:17 2033 GMT
       Subject: C = RU, ST = Moscow, O = Yandex, CN = localhost

       Issuer: C = RU, ST = Moscow, O = Yandex, CN = CA@localhost
       Validity
           Not Before: Jul 13 11:51:11 2023 GMT
           Not After : Jul 10 11:51:11 2033 GMT
       Subject: C = RU, ST = Moscow, O = Yandex, CN = CA@localhost

- **yt/core/https: verify server certificate**

NYT::NCrypto::TTlsConnection should verify server certificate and hostname.

---

* Changelog entry
Type: fix
Component: misc-server

Verify server certificate

---

Pull Request resolved: ytsaurus/ytsaurus#1357

Co-authored-by: yuryalekseev <yuryalekseev@yandex-team.com>
commit_hash:c88f00ab5fc82507b4b56c25cf25d18904aaec24
commit_hash:0cc244f5272c4bc099db5bf8fb56566a11391158
commit_hash:174c5be00dc424aab7b17eba148c192689222c45
KIKIMR-23622
commit_hash:8879357407b3b5ba4200e1f380922d4e68cc2973
Сейчас FilterPushdownOverJoinOptionalSide не работает если в предикате используются только колонки из ключа джоина — причин так делать нет, исправляю (под флагом временно чтобы канонизировать тесты ydb)
commit_hash:93aa956e4460d95e9e8592595de5e8a77027786b
commit_hash:8d3031aaf3f344572e98e205b92760187a97dd95
commit_hash:9b8fd0952d7d3e283fcc02ed3e9eb8b6e09607d7
Добавляю CUDA 12.9
commit_hash:879d19fb3f2c7cf5e101b6d673e200a819c94934
commit_hash:8a7fc218f76bbb66d7129f5450b1e9daab37bc8e
atarasov5 and others added 14 commits July 10, 2025 15:51
В данном PR включена поддержка валидации Datum'ов на соответствие `MKQL type <-> arrow type <-> arrow array data structure.`

Выявленные проблемы:
1\. `AllocateResizableBuffer(size_t size)` возвращает массив длины 0 вместо size. Поэтому есть ошибка в работе с датами в некоторых нодах
commit_hash:122f2bd114dec50993131391a3793d9540877cb4
* Changelog entry
  Type: feature
  Component: proxy

Support tz types in arrow parser.
commit_hash:4bc9c3bb135db4b30576a3a94ca24b21d17f9e2d
commit_hash:0db8837c719ce19cf1d9ef561ba7fd77f80a8ae8
- Added table functions completion.

- Also fixed a bug when USEd cluster
  was not added to table context at table
  function argument.

- Complete folder names at `prefix`
  of `LIKE`, `RANGE`, etc.
commit_hash:26be383be728796e8431f906e2815acd77645ad4
commit_hash:98f460965618cdddf9fc25373b20741b4e85a303
Backporting commit from upstream grpc/grpc#37696

KIKIMR-23576
commit_hash:70b894f6a164019d8febd081d12402de1a9fc07a
Escaping $ in jvm args
commit_hash:10cf49ab2f5f542559023e602f55314a3e335d9c
commit_hash:745dceac20d37dfe49e7fd69650c1d4b5779f5b3
```
[pg@arc ~]$ ./util-ut
<----- TSaveLoadTest
[exec] TSaveLoadTest::TestSaveLoad...
[good] TSaveLoadTest::TestSaveLoad
[exec] TSaveLoadTest::TestSaveLoadEmptyStruct...
[good] TSaveLoadTest::TestSaveLoadEmptyStruct
[exec] TSaveLoadTest::TestNewStyle...
[good] TSaveLoadTest::TestNewStyle
[exec] TSaveLoadTest::TestNewNewStyle...
[good] TSaveLoadTest::TestNewNewStyle
[exec] TSaveLoadTest::TestList...
[good] TSaveLoadTest::TestList
[exec] TSaveLoadTest::TestTuple...
[good] TSaveLoadTest::TestTuple
[exec] TSaveLoadTest::TestVariant...
[good] TSaveLoadTest::TestVariant
[exec] TSaveLoadTest::TestOptional...
[good] TSaveLoadTest::TestOptional
[exec] TSaveLoadTest::TestInheritNonVirtualClass...
[good] TSaveLoadTest::TestInheritNonVirtualClass
[exec] TSaveLoadTest::TestInheritVirtualClass...
[good] TSaveLoadTest::TestInheritVirtualClass
-----> TSaveLoadTest -> ok: 10
[DONE] ok: 10
[pg@arc ~]$ uname -a
FreeBSD arc.freebsd.devtools 14.2-RELEASE-p1 FreeBSD 14.2-RELEASE-p1 GENERIC amd64
[pg@arc ~]$
```
commit_hash:229d8aa6c8ccce1376d152a833fe8bf7c5faa3bd
commit_hash:91f77329ea1087b0436a5c5ee5fcd7273aeb7b27
Ignore src/test if no tests exported
commit_hash:469bf1ebdb33315684ce0b34c7fb332c23ab7004
commit_hash:d711f24fe0934dc2a089b6993f506a210ab55a51
@alexv-smirnov alexv-smirnov requested a review from a team as a code owner July 10, 2025 18:54
Copy link

🟢 2025-07-10 18:57:54 UTC The validation of the Pull Request description is successful.

Copy link

github-actions bot commented Jul 10, 2025

2025-07-10 18:58:39 UTC Pre-commit check linux-x86_64-release-asan for 97296cc has started.
2025-07-10 18:58:53 UTC Artifacts will be uploaded here
2025-07-10 19:05:47 UTC ya make is running...
🟡 2025-07-10 22:04:41 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
18291 17789 0 274 203 25

🟢 2025-07-10 22:06:16 UTC Build successful.
🟡 2025-07-10 22:06:47 UTC ydbd size 3.9 GiB changed* by +801.4 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: daf48b4 merge: 97296cc diff diff %
ydbd size 4 207 344 600 Bytes 4 208 165 216 Bytes +801.4 KiB +0.020%
ydbd stripped size 1 457 106 968 Bytes 1 457 437 688 Bytes +323.0 KiB +0.023%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Jul 10, 2025

2025-07-10 18:58:41 UTC Pre-commit check linux-x86_64-relwithdebinfo for 97296cc has started.
2025-07-10 18:58:56 UTC Artifacts will be uploaded here
2025-07-10 19:05:41 UTC ya make is running...
🟡 2025-07-10 21:29:05 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
40894 38140 0 1 2702 51

2025-07-10 21:32:44 UTC ya make is running... (failed tests rerun, try 2)
🟢 2025-07-10 21:46:49 UTC Tests successful.

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
526 (only retried tests) 478 0 0 11 37

🟢 2025-07-10 21:46:58 UTC Build successful.
🟡 2025-07-10 21:47:16 UTC ydbd size 2.2 GiB changed* by +447.2 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: daf48b4 merge: 97296cc diff diff %
ydbd size 2 392 679 696 Bytes 2 393 137 592 Bytes +447.2 KiB +0.019%
ydbd stripped size 500 356 520 Bytes 500 450 568 Bytes +91.8 KiB +0.019%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@alexv-smirnov alexv-smirnov merged commit d5517f7 into main Jul 10, 2025
16 of 18 checks passed
@pzuev pzuev linked an issue Jul 11, 2025 that may be closed by this pull request
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[stable-25-1] GROUP BY does not group nulls
9 participants