Skip to content

Conversation

kunga
Copy link
Member

@kunga kunga commented Sep 8, 2025

Changelog entry

...

Changelog category

  • Not for changelog (changelog entry is not required)

Description for reviewers

https://t.me/c/1952638471/9033

@kunga kunga changed the title Fulltext-repeated Support multiple columns in fulltext index Sep 8, 2025
Copy link

github-actions bot commented Sep 8, 2025

2025-09-08 14:59:58 UTC Pre-commit check linux-x86_64-release-asan for 4862d14 has started.
2025-09-08 15:01:00 UTC Artifacts will be uploaded here
2025-09-08 15:05:36 UTC ya make is running...
🟡 2025-09-08 17:52:12 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
17962 17463 0 152 321 26

🟢 2025-09-08 17:53:55 UTC Build successful.

}

// See Layout enum
Layout layout = 1;
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

не вижу пока причин делать какой-то разный layout для разных колонок, поэтому он на уровне выше

@kunga kunga self-assigned this Sep 8, 2025
Copy link

github-actions bot commented Sep 8, 2025

2025-09-08 15:02:36 UTC Pre-commit check linux-x86_64-relwithdebinfo for 4862d14 has started.
2025-09-08 15:02:52 UTC Artifacts will be uploaded here
2025-09-08 15:06:45 UTC ya make is running...
🟡 2025-09-08 17:08:03 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
40699 37939 0 4 2720 36

2025-09-08 17:11:46 UTC ya make is running... (failed tests rerun, try 2)
🟡 2025-09-08 17:26:04 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
673 (only retried tests) 644 0 2 1 26

2025-09-08 17:26:16 UTC ya make is running... (failed tests rerun, try 3)
🟢 2025-09-08 17:40:18 UTC Tests successful.

Test history | Ya make output | Test bloat | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
481 (only retried tests) 458 0 0 0 23

🟢 2025-09-08 17:40:28 UTC Build successful.

Copy link

github-actions bot commented Sep 9, 2025

2025-09-09 08:57:35 UTC Pre-commit check linux-x86_64-release-asan for a4d72d9 has started.
2025-09-09 08:57:49 UTC Artifacts will be uploaded here
2025-09-09 09:00:13 UTC Check cancelled

Copy link

github-actions bot commented Sep 9, 2025

2025-09-09 08:57:35 UTC Pre-commit check linux-x86_64-relwithdebinfo for a4d72d9 has started.
2025-09-09 08:57:50 UTC Artifacts will be uploaded here
2025-09-09 09:00:13 UTC Check cancelled

@kunga kunga requested a review from Copilot September 9, 2025 08:58
Copy link
Contributor

@Copilot Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR modernizes fulltext index configuration by replacing the flat field-based settings structure with a nested column-specific analyzer configuration system.

  • Introduces a new ColumnAnalyzers message that encapsulates analyzer settings per column
  • Migrates existing tokenizer, language, and filter settings into an Analyzers structure
  • Updates test cases to use the new configuration format with proper validation for column matching

Reviewed Changes

Copilot reviewed 4 out of 4 changed files in this pull request and generated no comments.

File Description
ydb/public/api/protos/ydb_table.proto Restructures FulltextIndexSettings with column-specific analyzers and moves analyzer settings into nested messages
ydb/core/tx/schemeshard/ut_index/ut_fulltext_index.cpp Updates test cases to use new column-based fulltext settings format and adds validation tests
ydb/core/tx/schemeshard/ut_helpers/ls_checks.cpp Enhances SpecializedIndexDescription to use proper protobuf comparison instead of string comparison
ydb/core/tx/schemeshard/schemeshard_utils.h Adds validation logic to ensure column settings match index key columns
Comments suppressed due to low confidence (3)

ydb/public/api/protos/ydb_table.proto:1

  • Method name should be GetColumns() instead of Getcolumns(). Proto field accessors typically use PascalCase.
syntax = "proto3";

ydb/public/api/protos/ydb_table.proto:1

  • Method names should be GetColumns() and GetColumn() instead of Getcolumns() and Getcolumn(). Proto field accessors typically use PascalCase.
syntax = "proto3";

ydb/public/api/protos/ydb_table.proto:1

  • Method names should be GetColumns() and GetColumn() instead of Getcolumns() and Getcolumn(). Proto field accessors typically use PascalCase.
syntax = "proto3";

Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.

Copy link

github-actions bot commented Sep 9, 2025

2025-09-09 09:01:38 UTC Pre-commit check linux-x86_64-release-asan for 87fa0af has started.
2025-09-09 09:01:52 UTC Artifacts will be uploaded here
2025-09-09 09:05:50 UTC ya make is running...
2025-09-09 11:41:49 UTC Check cancelled

Copy link

github-actions bot commented Sep 9, 2025

2025-09-09 09:01:40 UTC Pre-commit check linux-x86_64-relwithdebinfo for 87fa0af has started.
2025-09-09 09:01:54 UTC Artifacts will be uploaded here
2025-09-09 09:05:59 UTC ya make is running...
🟡 2025-09-09 11:19:43 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
40699 37925 0 7 2731 36

2025-09-09 11:23:22 UTC ya make is running... (failed tests rerun, try 2)
🟡 2025-09-09 11:38:59 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
691 (only retried tests) 664 0 1 0 26

2025-09-09 11:39:10 UTC ya make is running... (failed tests rerun, try 3)
2025-09-09 11:41:16 UTC Check cancelled

@kunga kunga requested a review from azevaykin September 9, 2025 10:04
@kunga kunga marked this pull request as ready for review September 9, 2025 10:04
@kunga kunga requested a review from a team as a code owner September 9, 2025 10:04
Copy link

github-actions bot commented Sep 9, 2025

2025-09-09 11:42:38 UTC Pre-commit check linux-x86_64-release-asan for 6ecef53 has started.
2025-09-09 11:42:42 UTC Artifacts will be uploaded here
2025-09-09 11:46:35 UTC ya make is running...
🟡 2025-09-09 13:50:46 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
17964 17524 0 112 301 27

🟢 2025-09-09 13:52:24 UTC Build successful.

Copy link

github-actions bot commented Sep 9, 2025

2025-09-09 11:45:16 UTC Pre-commit check linux-x86_64-relwithdebinfo for 6ecef53 has started.
2025-09-09 11:45:30 UTC Artifacts will be uploaded here
2025-09-09 11:49:22 UTC ya make is running...
🟡 2025-09-09 13:08:05 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
40701 37776 0 5 2881 39

2025-09-09 13:12:01 UTC ya make is running... (failed tests rerun, try 2)
🟢 2025-09-09 13:27:54 UTC Tests successful.

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
811 (only retried tests) 708 0 0 79 24

🟢 2025-09-09 13:28:05 UTC Build successful.

@kunga kunga requested a review from snaury September 9, 2025 13:28
@kunga kunga merged commit b2d18fd into ydb-platform:dev-fulltext Sep 9, 2025
12 checks passed
@kunga kunga mentioned this pull request Sep 9, 2025
12 tasks
AlexanderShprot pushed a commit to AlexanderShprot/ydb that referenced this pull request Sep 25, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants