Skip to content

YDB FQ: support OpenSearch as an external data source #18444

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
vitalyisaev2 merged 4 commits into from
Jun 10, 2025
Merged

YDB FQ: support OpenSearch as an external data source #18444

vitalyisaev2 merged 4 commits into from
Jun 10, 2025

Conversation

@Arslanka
Copy link
Contributor

@Arslanka Arslanka commented May 17, 2025

Changelog entry

YDB FQ: support OpenSearch as an external data source

Changelog category

  • New feature

Description for reviewers

...

@Arslanka Arslanka requested a review from a team as a code owner May 17, 2025 16:50
@github-actions
Copy link

github-actions bot commented May 17, 2025

Hi! Thank you for contributing!
The tests on this PR will run after a maintainer adds an ok-to-test label to this PR manually. Thank you for your patience!

@Arslanka Arslanka changed the title YDB FQ: support OpenSearch as an external datasource YDB FQ: support OpenSearch as an external data source May 17, 2025
@github-actions
Copy link

github-actions bot commented May 17, 2025 •
edited
Loading

🟢 2025-05-17 16:53:53 UTC The validation of the Pull Request description is successful.

@maximyurchuk maximyurchuk added the ok-to-test Special label used to approve a PR for testing on our infrastructure label May 18, 2025
@github-actions github-actions bot removed the ok-to-test Special label used to approve a PR for testing on our infrastructure label May 18, 2025
@github-actions
Copy link

github-actions bot commented May 18, 2025 •
edited
Loading

⚪ 2025-05-18 19:47:27 UTC Pre-commit check linux-x86_64-release-asan for 14ab5b0 has started.
⚪ 2025-05-18 19:47:39 UTC Artifacts will be uploaded here
⚪ 2025-05-18 19:50:37 UTC ya make is running...
🟡 2025-05-18 21:33:29 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
14923 14748 0 99 46 30

⚪ 2025-05-18 21:34:45 UTC ya make is running... (failed tests rerun, try 2)
🟡 2025-05-18 22:05:29 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet Going to retry failed tests...

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
1545 (only retried tests) 1441 0 55 23 26

⚪ 2025-05-18 22:05:46 UTC ya make is running... (failed tests rerun, try 3)
🟡 2025-05-18 22:36:57 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
1072 (only retried tests) 976 0 46 25 25

🟢 2025-05-18 22:37:11 UTC Build successful.
🟢 2025-05-18 22:37:43 UTC ydbd size 3.9 GiB changed* by +16.4 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: b202164 merge: 14ab5b0 diff diff %
ydbd size 4 141 806 352 Bytes 4 141 823 184 Bytes +16.4 KiB +0.000%
ydbd stripped size 1 437 656 376 Bytes 1 437 660 600 Bytes +4.1 KiB +0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@github-actions
Copy link

github-actions bot commented May 18, 2025 •
edited
Loading

⚪ 2025-05-18 19:47:28 UTC Pre-commit check linux-x86_64-relwithdebinfo for 14ab5b0 has started.
⚪ 2025-05-18 19:47:39 UTC Artifacts will be uploaded here
⚪ 2025-05-18 19:50:41 UTC ya make is running...
🟡 2025-05-18 21:20:15 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
29850 27159 0 4 2644 43

⚪ 2025-05-18 21:22:41 UTC ya make is running... (failed tests rerun, try 2)
🟡 2025-05-18 21:48:07 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
783 (only retried tests) 746 0 1 2 34

⚪ 2025-05-18 21:48:18 UTC ya make is running... (failed tests rerun, try 3)
🟢 2025-05-18 22:13:49 UTC Tests successful.

Test history | Ya make output | Test bloat | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
118 (only retried tests) 81 0 0 4 33

🟢 2025-05-18 22:13:56 UTC Build successful.
🟢 2025-05-18 22:14:19 UTC ydbd size 2.2 GiB changed* by +8.9 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: b202164 merge: 14ab5b0 diff diff %
ydbd size 2 354 373 080 Bytes 2 354 382 216 Bytes +8.9 KiB +0.000%
ydbd stripped size 494 720 968 Bytes 494 722 696 Bytes +1.7 KiB +0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@vitalyisaev2 vitalyisaev2 added the ok-to-test Special label used to approve a PR for testing on our infrastructure label May 19, 2025
@github-actions github-actions bot removed the ok-to-test Special label used to approve a PR for testing on our infrastructure label May 19, 2025
vitalyisaev2
vitalyisaev2 suggested changes May 19, 2025
View reviewed changes
@vitalyisaev2 vitalyisaev2 added the ok-to-test Special label used to approve a PR for testing on our infrastructure label Jun 10, 2025
@github-actions github-actions bot removed the ok-to-test Special label used to approve a PR for testing on our infrastructure label Jun 10, 2025
@github-actions
Copy link

github-actions bot commented Jun 10, 2025 •
edited
Loading

⚪ 2025-06-10 10:45:06 UTC Pre-commit check linux-x86_64-relwithdebinfo for 467a3f0 has started.
⚪ 2025-06-10 10:45:09 UTC Artifacts will be uploaded here
⚪ 2025-06-10 10:48:21 UTC ya make is running...
🟡 2025-06-10 12:34:14 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
30805 28096 0 8 2670 31

⚪ 2025-06-10 12:37:00 UTC ya make is running... (failed tests rerun, try 2)
🟢 2025-06-10 12:49:42 UTC Tests successful.

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
796 (only retried tests) 773 0 0 0 23

🟢 2025-06-10 12:49:51 UTC Build successful.
🟢 2025-06-10 12:50:13 UTC ydbd size 2.2 GiB changed* by +7.2 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: bc45efa merge: 467a3f0 diff diff %
ydbd size 2 371 163 928 Bytes 2 371 171 336 Bytes +7.2 KiB +0.000%
ydbd stripped size 497 356 616 Bytes 497 358 152 Bytes +1.5 KiB +0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@github-actions
Copy link

github-actions bot commented Jun 10, 2025 •
edited
Loading

⚪ 2025-06-10 10:47:28 UTC Pre-commit check linux-x86_64-release-asan for 467a3f0 has started.
⚪ 2025-06-10 10:47:40 UTC Artifacts will be uploaded here
⚪ 2025-06-10 10:50:57 UTC ya make is running...
🟡 2025-06-10 13:13:25 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
15641 15427 0 90 101 23

⚪ 2025-06-10 13:14:50 UTC ya make is running... (failed tests rerun, try 2)
🟡 2025-06-10 13:53:13 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet Going to retry failed tests...

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
1568 (only retried tests) 1423 0 56 66 23

⚪ 2025-06-10 13:53:30 UTC ya make is running... (failed tests rerun, try 3)
🟡 2025-06-10 14:28:11 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
1378 (only retried tests) 1240 0 58 59 21

🟢 2025-06-10 14:28:27 UTC Build successful.
🟢 2025-06-10 14:28:59 UTC ydbd size 3.9 GiB changed* by +19.0 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: 47ef22c merge: 467a3f0 diff diff %
ydbd size 4 170 152 808 Bytes 4 170 172 296 Bytes +19.0 KiB +0.000%
ydbd stripped size 1 446 423 608 Bytes 1 446 431 608 Bytes +7.8 KiB +0.001%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@vitalyisaev2 vitalyisaev2 merged commit f40ec86 into ydb-platform:main Jun 10, 2025
18 checks passed
yumkam
yumkam reviewed Jun 10, 2025
View reviewed changes
ydb/library/yql/providers/generic/connector/tests/utils/run/kqprun.py
AvailableExternalDataSources: "Redis"
AvailableExternalDataSources: "Prometheus"
AvailableExternalDataSources: "OpenSearch"
AllExternalDataSourcesAreAvailable: true
Copy link
Collaborator

@yumkam yumkam Jun 10, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Кмк, с All-E-D-S-A-A явное перечисление всех A-E-D-S выше не нужно

@liruoko liruoko added the release-scope-25-3 Для PR-ов. Означает "этот PR вошел в состав одной из версий 25-3-nnn" label Oct 13, 2025
@liruoko liruoko added the changelog/f25-3 PR участвует в списке изменений label Nov 19, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@yumkam yumkam yumkam left review comments

@uzhastik uzhastik uzhastik approved these changes

+1 more reviewer

@vitalyisaev2 vitalyisaev2 vitalyisaev2 approved these changes

Reviewers whose approvals may not affect merge requirements

Assignees

No one assigned

Labels

changelog/f25-3 PR участвует в списке изменений external new-feature release-scope-25-3 Для PR-ов. Означает "этот PR вошел в состав одной из версий 25-3-nnn"

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

6 participants

@Arslanka @yumkam @vitalyisaev2 @uzhastik @liruoko @maximyurchuk