Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-33670][SQL][3.0] Verify the partition provider is Hive in v1 SHOW TABLE EXTENDED #30640

Commits on Dec 7, 2020

  1. [SPARK-33670][SQL] Verify the partition provider is Hive in v1 SHOW T…

    …ABLE EXTENDED
    
    Invoke the check `DDLUtils.verifyPartitionProviderIsHive()` from V1 implementation of `SHOW TABLE EXTENDED` when partition specs are specified.
    
    This PR is some kind of follow up apache#16373 and apache#15515.
    
    To output an user friendly error with recommendation like
    **"
    ... partition metadata is not stored in the Hive metastore. To import this information into the metastore, run `msck repair table tableName`
    "**
    instead of silently output an empty result.
    
    Yes.
    
    By running the affected test suites, in particular:
    ```
    $ build/sbt -Phive-2.3 -Phive-thriftserver "hive/test:testOnly *PartitionProviderCompatibilitySuite"
    ```
    
    Closes apache#30618 from MaxGekk/show-table-extended-verifyPartitionProviderIsHive.
    
    Authored-by: Max Gekk <max.gekk@gmail.com>
    Signed-off-by: HyukjinKwon <gurwls223@apache.org>
    (cherry picked from commit 29096a8)
    Signed-off-by: Max Gekk <max.gekk@gmail.com>
    MaxGekk committed Dec 7, 2020
    Configuration menu
    Copy the full SHA
    8ce6822 View commit details
    Browse the repository at this point in the history