Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Speed up SQL IN using SCALAR_IN_ARRAY. #16388

Merged
merged 7 commits into from
May 14, 2024

Commits on May 3, 2024

  1. Speed up SQL IN using SCALAR_IN_ARRAY.

    Main changes:
    
    1) DruidSqlValidator now includes a rewrite of IN to SCALAR_IN_ARRAY, when the size of
       the IN is above inFunctionThreshold. The default value of inFunctionThreshold
       is 100. Users can restore the prior behavior by setting it to Integer.MAX_VALUE.
    
    2) SearchOperatorConversion now generates SCALAR_IN_ARRAY when converting to a regular
       expression, when the size of the SEARCH is above inFunctionExprThreshold. The default
       value of inFunctionExprThreshold is 2. Users can restore the prior behavior by setting
       it to Integer.MAX_VALUE.
    
    3) ReverseLookupRule generates SCALAR_IN_ARRAY if the set of reverse-looked-up values is
       greater than inFunctionThreshold.
    gianm committed May 3, 2024
    Configuration menu
    Copy the full SHA
    b11d3aa View commit details
    Browse the repository at this point in the history
  2. Revert test.

    gianm committed May 3, 2024
    Configuration menu
    Copy the full SHA
    11940ae View commit details
    Browse the repository at this point in the history

Commits on May 7, 2024

  1. Configuration menu
    Copy the full SHA
    86bff63 View commit details
    Browse the repository at this point in the history
  2. Additional coverage.

    gianm committed May 7, 2024
    Configuration menu
    Copy the full SHA
    d95ef2c View commit details
    Browse the repository at this point in the history

Commits on May 9, 2024

  1. Update docs/querying/sql-query-context.md

    Co-authored-by: Benedict Jin <asdf2014@apache.org>
    gianm and asdf2014 committed May 9, 2024
    Configuration menu
    Copy the full SHA
    492c80c View commit details
    Browse the repository at this point in the history

Commits on May 13, 2024

  1. New test.

    gianm committed May 13, 2024
    Configuration menu
    Copy the full SHA
    7d63105 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    e44a389 View commit details
    Browse the repository at this point in the history