Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

YQL-18464: Fix Remove UDFs for NonASCII input #4789

Conversation

igormunkin
Copy link
Collaborator

The signed char was used as the index value in the loop, collecting "to-be-removed" charset. As a result, processing all NonASCII bytes (i.e. greater than 127) leads to an invalid result. The patch changes the index value type to the unsigned one.

Follows up #2836

Changelog category

  • Bugfix

@igormunkin igormunkin changed the title YQLSUPPORT-5228: Fix String::RemoveAll for NonASCII input YQLSUPPORT-5228: Fix Remove UDFs for NonASCII input May 23, 2024
Copy link

github-actions bot commented May 23, 2024

2024-05-23 14:50:22 UTC Pre-commit check for de6b257 has started.
2024-05-23 14:52:27 UTC Build linux-x86_64-relwithdebinfo is running...
2024-05-23 14:53:14 UTC Check cancelled

@igormunkin igormunkin force-pushed the YQLSUPPORT-5228-fix-removeall-udf-for-nonascii branch from 0b69d72 to 36d2225 Compare May 23, 2024 14:52
Copy link

github-actions bot commented May 23, 2024

2024-05-23 15:00:59 UTC Pre-commit check for eece0a9 has started.
2024-05-23 15:03:16 UTC Build linux-x86_64-release-clang14 is running...
🟢 2024-05-23 15:05:38 UTC Build successful.

Copy link

github-actions bot commented May 23, 2024

2024-05-23 15:05:54 UTC Pre-commit check for eece0a9 has started.
2024-05-23 15:08:49 UTC Build linux-x86_64-release-asan is running...
🟢 2024-05-23 15:11:01 UTC Build successful.
2024-05-23 15:11:13 UTC Tests are running...
🔴 2024-05-23 15:56:27 UTC Test run completed, no test results found for commit 36d2225. Please check build logs.
2024-05-23 15:56:33 UTC Check cancelled

Copy link

github-actions bot commented May 23, 2024

2024-05-23 15:07:24 UTC Pre-commit check for eece0a9 has started.
2024-05-23 15:09:33 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-05-23 15:11:14 UTC Build successful.
2024-05-23 15:11:23 UTC Tests are running...
🔴 2024-05-23 15:56:27 UTC Test run completed, no test results found for commit 36d2225. Please check build logs.
2024-05-23 15:56:34 UTC Check cancelled

The signed char was used as the index value in the loop, collecting
"to-be-removed" charset. As a result, processing all NonASCII bytes
(i.e. greater than 127) leads to an invalid result. The patch changes
the index value type to the unsigned one.

Follows up ydb-platform#2836
@igormunkin igormunkin force-pushed the YQLSUPPORT-5228-fix-removeall-udf-for-nonascii branch from 36d2225 to 07f3549 Compare May 23, 2024 15:56
igormunkin added a commit to igormunkin/ydb that referenced this pull request May 23, 2024
The signed char was used as the index value in the loop, collecting
"to-be-removed" charset. As a result, processing all NonASCII bytes
(i.e. greater than 127) leads to an invalid result. The patch changes
the index value type to the unsigned one.

Follows up ydb-platform#2836

(cherry picked from ydb-platform#4789)
Copy link

github-actions bot commented May 23, 2024

2024-05-23 16:07:12 UTC Pre-commit check for b236f1d has started.
2024-05-23 16:09:22 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-05-23 16:11:07 UTC Build successful.
2024-05-23 16:11:16 UTC Tests are running...
🟢 2024-05-23 17:44:47 UTC Tests successful.

Test history

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
59092 46820 0 0 12268 4

Copy link

github-actions bot commented May 23, 2024

2024-05-23 16:07:12 UTC Pre-commit check for b236f1d has started.
2024-05-23 16:09:18 UTC Build linux-x86_64-release-clang14 is running...
🟢 2024-05-23 16:10:54 UTC Build successful.

Copy link

github-actions bot commented May 23, 2024

2024-05-23 16:09:36 UTC Pre-commit check for b236f1d has started.
2024-05-23 16:11:48 UTC Build linux-x86_64-release-asan is running...
🟢 2024-05-23 16:13:28 UTC Build successful.
2024-05-23 16:13:41 UTC Tests are running...
🔴 2024-05-23 17:32:21 UTC Some tests failed, follow the links below.

Test history

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
5678 5625 0 18 24 11

@igormunkin igormunkin marked this pull request as ready for review May 23, 2024 16:20
@igormunkin igormunkin requested a review from a team as a code owner May 23, 2024 16:20
@igormunkin igormunkin changed the title YQLSUPPORT-5228: Fix Remove UDFs for NonASCII input YQL-18464: Fix Remove UDFs for NonASCII input May 23, 2024
@igormunkin igormunkin merged commit 2ed4009 into ydb-platform:main May 23, 2024
5 of 6 checks passed
igormunkin added a commit that referenced this pull request May 23, 2024
@igormunkin igormunkin deleted the YQLSUPPORT-5228-fix-removeall-udf-for-nonascii branch May 23, 2024 18:58
MrLolthe1st pushed a commit to MrLolthe1st/ydb that referenced this pull request May 28, 2024
@niksaveliev niksaveliev mentioned this pull request May 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants