Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-21089] [SQL] Fix DESC EXTENDED/FORMATTED to Show Table Properties #18294

Closed
wants to merge 2 commits into from

Conversation

gatorsmile
Copy link
Member

What changes were proposed in this pull request?

Since both table properties and storage properties share the same key values, table properties are not shown in the output of DESC EXTENDED/FORMATTED when the storage properties are not empty.

This PR is to fix the above issue by renaming them to different keys.

How was this patch tested?

Added test cases.

@@ -127,8 +127,9 @@ Provider parquet
Num Buckets 2
Bucket Columns [`a`]
Sort Columns [`b`]
Properties [a=1, b=2]
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Before the changes of this PR

Location [not included in comparison]sql/core/spark-warehouse/t
Storage Properties [a=1, b=2]
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

After the change of this PR, both appear.

@@ -127,8 +127,9 @@ Provider parquet
Num Buckets 2
Bucket Columns [`a`]
Sort Columns [`b`]
Properties [a=1, b=2]
Table Properties [e=3]
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

After the change of this PR, both appear.

@gatorsmile
Copy link
Member Author

cc @cloud-fan

@SparkQA
Copy link

SparkQA commented Jun 14, 2017

Test build #78027 has started for PR 18294 at commit 24cc162.

@SparkQA
Copy link

SparkQA commented Jun 14, 2017

Test build #78025 has finished for PR 18294 at commit c409dea.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@cloud-fan
Copy link
Contributor

the test failure is legitimate

@gatorsmile
Copy link
Member Author

retest this please

@gatorsmile
Copy link
Member Author

@cloud-fan That is by the first commit, whose output is generated by the codes before the fix.

@SparkQA
Copy link

SparkQA commented Jun 14, 2017

Test build #78053 has finished for PR 18294 at commit 24cc162.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@ueshin
Copy link
Member

ueshin commented Jun 14, 2017

LGTM.

@asfgit asfgit closed this in df766a4 Jun 14, 2017
asfgit pushed a commit that referenced this pull request Jun 14, 2017
Since both table properties and storage properties share the same key values, table properties are not shown in the output of DESC EXTENDED/FORMATTED when the storage properties are not empty.

This PR is to fix the above issue by renaming them to different keys.

Added test cases.

Author: Xiao Li <gatorsmile@gmail.com>

Closes #18294 from gatorsmile/tableProperties.

(cherry picked from commit df766a4)
Signed-off-by: Xiao Li <gatorsmile@gmail.com>
dataknocker pushed a commit to dataknocker/spark that referenced this pull request Jun 16, 2017
### What changes were proposed in this pull request?

Since both table properties and storage properties share the same key values, table properties are not shown in the output of DESC EXTENDED/FORMATTED when the storage properties are not empty.

This PR is to fix the above issue by renaming them to different keys.

### How was this patch tested?
Added test cases.

Author: Xiao Li <gatorsmile@gmail.com>

Closes apache#18294 from gatorsmile/tableProperties.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
4 participants