Skip to content

[CALCITE-6699] Invalid unparse for Varchar in StarRocksDialect#4055

Closed
xiaochen-zhou wants to merge 1 commit intoapache:mainfrom
xiaochen-zhou:sr_varchar
Closed

[CALCITE-6699] Invalid unparse for Varchar in StarRocksDialect#4055
xiaochen-zhou wants to merge 1 commit intoapache:mainfrom
xiaochen-zhou:sr_varchar

Conversation

@xiaochen-zhou
Copy link
Copy Markdown
Contributor

@sonarqubecloud
Copy link
Copy Markdown

@xiaochen-zhou xiaochen-zhou changed the title [CALCITE-6699] Invalid unparse for INT and BIGINT in StarRocksDialect [CALCITE-6699] Invalid unparse for Varchar in StarRocksDialect Nov 19, 2024
return new SqlDataTypeSpec(
new SqlBasicTypeNameSpec(SqlTypeName.BIGINT, SqlParserPos.ZERO),
SqlParserPos.ZERO);
case VARCHAR:
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We need to add a unit test.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

what happens to the precision if it is specified?

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1. The accuracy issue is not considered here.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

test

Sorry for the late reply. I will add it later today.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

what happens to the precision if it is specified?

I initially thought that if precision is not set here, the default precision for varchar might be used. However, I just looked at the code, and it seems that if precision is not set, the default is PRECISION_NOT_SPECIFIED. Could this lead to a loss of precision, or did I not look at the code carefully?

@mihaibudiu @caicancai

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You can try to follow the startRocks behavior. Does Starrocks support Varchar without setting precision? If so, add test cases to override it. If not, set the default varchar precision to Starrocks' default value. Also, add unit test to cover when Varchar setting precision.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I tried cast varchar with precision in Starrocks, and it seems that the precision doesn't affect the result and type(If the precision does not exceed 65533).

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I tried cast varchar with precision in Starrocks, and it seems that the precision doesn't affect the result and type(If the precision does not exceed 65533).

Although this is not a common situation, we should still consider it.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

VARCHAR(N) is supposed to truncate to N characters, and then trim the whitespaces from the end of the string.
If the dialect does not support VARCHAR(N) perhaps it should report an error when an attempt is made to use it.
Then you should also add an assertion that the precision is "not specified".

@github-actions
Copy link
Copy Markdown

This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 90 days if no further activity occurs. If you think that’s incorrect or this pull request requires a review, please simply write any comment. If closed, you can revive the PR at any time and @mention a reviewer or discuss it on the dev@calcite.apache.org list. Thank you for your contributions.

@github-actions github-actions bot added the stale label Dec 21, 2024
@xiaochen-zhou xiaochen-zhou deleted the sr_varchar branch January 4, 2025 11:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants