New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SPARK-12012][SQL] Backports PR #10004 to branch-1.6 #10250
Conversation
…visualizing SQL query plan This PR adds a `private[sql]` method `metadata` to `SparkPlan`, which can be used to describe detail information about a physical plan during visualization. Specifically, this PR uses this method to provide details of `PhysicalRDD`s translated from a data source relation. For example, a `ParquetRelation` converted from Hive metastore table `default.psrc` is now shown as the following screenshot: ![image](https://cloud.githubusercontent.com/assets/230655/11526657/e10cb7e6-9916-11e5-9afa-f108932ec890.png) And here is the screenshot for a regular `ParquetRelation` (not converted from Hive metastore table) loaded from a really long path: ![output](https://cloud.githubusercontent.com/assets/230655/11680582/37c66460-9e94-11e5-8f50-842db5309d5a.png) Author: Cheng Lian <lian@databricks.com> Closes apache#10004 from liancheng/spark-12012.physical-rdd-metadata.
test this please |
Nvm, just found out that it's scheduled maintenance. |
Actually it doesn't seem to be scheduled. The message "Jenkins is going to shut down" has been there for at least 6 hours. |
Test build #47521 has finished for PR 10250 at commit
|
retest this please |
Test build #47523 has finished for PR 10250 at commit
|
For backport, it will be great if we still use the original title. I am merging it in and change the title. |
…tadata when visualizing SQL query plan This PR backports PR #10004 to branch-1.6 It adds a private[sql] method metadata to SparkPlan, which can be used to describe detail information about a physical plan during visualization. Specifically, this PR uses this method to provide details of PhysicalRDDs translated from a data source relation. Author: Cheng Lian <lian@databricks.com> Closes #10250 from liancheng/spark-12012.for-1.6.
I have merged it. Let's close this PR. |
No description provided.