Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] Create Skipping Index does not support multiple part identifier #353

Closed
penghuo opened this issue May 21, 2024 · 1 comment · Fixed by #366
Closed

[BUG] Create Skipping Index does not support multiple part identifier #353

penghuo opened this issue May 21, 2024 · 1 comment · Fixed by #366
Assignees
Labels
0.5 bug Something isn't working

Comments

@penghuo
Copy link
Collaborator

penghuo commented May 21, 2024

What is the bug?
Create Skipping Index statement does not support multiple part identifier

How can one reproduce the bug?

  • submit create skipping index
CREATE SKIPPING INDEX ON glue.default.vpc_flow ( accountid BLOOM_FILTER, region VALUE_SET, severity_id VALUE_SET, src_endpoint.ip BLOOM_FILTER, dst_endpoint.ip BLOOM_FILTER, src_endpoint.svc_name VALUE_SET, dst_endpoint.svc_name VALUE_SET, request_processing_time MIN_MAX, traffic.bytes MIN_MAX ) WITH ( auto_refresh = true, refresh_interval = '15 Minutes', checkpoint_location = 's3://bucket/', watermark_delay = '1 Minute' )
24/05/21 18:31:54 INFO FlintREPL: command complete: FlintCommand(state=failed, query=CREATE SKIPPING INDEX ON glue.default.amazon_vpc_flow ( accountid BLOOM_FILTER, region VALUE_SET, severity_id VALUE_SET, src_endpoint.ip BLOOM_FILTER, dst_endpoint.ip BLOOM_FILTER, src_endpoint.svc_name VALUE_SET, dst_endpoint.svc_name VALUE_SET, request_processing_time MIN_MAX, traffic.bytes MIN_MAX ) WITH ( auto_refresh = true, refresh_interval = '15 Minutes', checkpoint_location = 's3://bucket/', watermark_delay = '1 Minute' ) , statementId=N01wQlZUbkQ1U2ZsaW50X2FsbF9wZXJtaXNzaW9ucw==, queryId=N01wQlZUbkQ1U2ZsaW50X2FsbF9wZXJtaXNzaW9ucw==, submitTime=1716316289390, error=Some({"Message":"Syntax error: \nSyntax error at or near 'SKIPPING'(line 1, pos 7)\n\n== SQL ==\nCREATE SKIPPING INDEX ON glue.default.amazon_vpc_flow ( accountid BLOOM_FILTER, region VALUE_SET, severity_id VALUE_SET, src_endpoint.ip BLOOM_FILTER, dst_endpoint.ip BLOOM_FILTER, src_endpoint.svc_name VALUE_SET, dst_endpoint.svc_name VALUE_SET, request_processing_time MIN_MAX, traffic.bytes MIN_MAX ) WITH ( auto_refresh = true, refresh_interval = '15 Minutes', checkpoint_location = 's3://glue, watermark_delay = '1 Minute' ) \n-------^^^\n"}))

What is the expected behavior?
create index sucessfully

What is your host/environment?

  • opensearch-spark version 0.4
@penghuo penghuo added bug Something isn't working untriaged labels May 21, 2024
@dai-chen
Copy link
Collaborator

As a workaround, user can backtick the entire column name with dots. I quick verified that this works for both skipping index building and query write. Here is the sample query:

CREATE SKIPPING INDEX ON glue.default.amazon_vpc_flow (
  accountid BLOOM_FILTER,
  region VALUE_SET,
  severity_id VALUE_SET,
  `src_endpoint.ip` BLOOM_FILTER,
  `dst_endpoint.ip` BLOOM_FILTER,
  ...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
0.5 bug Something isn't working
Development

Successfully merging a pull request may close this issue.

2 participants