Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[SPARK-5310] [SQL] [DOC] Parquet section for the SQL programming guide #5001

Closed
wants to merge 3 commits into from
Closed

[SPARK-5310] [SQL] [DOC] Parquet section for the SQL programming guide #5001

wants to merge 3 commits into from

Conversation

liancheng
Copy link
Contributor

Also fixed a bunch of minor styling issues.

Review on Reviewable

@liancheng liancheng changed the title [SQL] [DOC] Parquet section for the SQL programming guide [SPARK-5310] [SQL] [DOC] Parquet section for the SQL programming guide Mar 12, 2015
@SparkQA
Copy link

SparkQA commented Mar 12, 2015

Test build #28519 has started for PR 5001 at commit 7eb6955.

  • This patch merges cleanly.

@SparkQA
Copy link

SparkQA commented Mar 12, 2015

Test build #28519 has finished for PR 5001 at commit 7eb6955.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@AmplabJenkins
Copy link

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/28519/
Test PASSed.

rxin
rxin reviewed Mar 12, 2015
View reviewed changes
docs/sql-programming-guide.md
the path of each partition directory. The Parquet data source is now able to discover and infer
partitioning information automatically. For exmaple, we can store all our previously used
population data into a partitioned table using the following directory structure, with two extra
columns, `sex` and `country` as partitioning columns:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can we use "gender"?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ah, sure.

@SparkQA
Copy link

SparkQA commented Mar 13, 2015

Test build #28540 has started for PR 5001 at commit 89ad3db.

  • This patch merges cleanly.

@SparkQA
Copy link

SparkQA commented Mar 13, 2015

Test build #28540 has finished for PR 5001 at commit 89ad3db.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@AmplabJenkins
Copy link

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/28540/
Test PASSed.

@rxin
Copy link
Contributor

rxin commented Mar 13, 2015

lgtm

@asfgit asfgit closed this in 69ff8e8 Mar 13, 2015
asfgit pushed a commit that referenced this pull request Mar 13, 2015
@liancheng
[SPARK-5310] [SQL] [DOC] Parquet section for the SQL programming guide
dc287f3 
Also fixed a bunch of minor styling issues.

<!-- Reviewable:start -->
[<img src="https://reviewable.io/review_button.png" height=40 alt="Review on Reviewable"/>](https://reviewable.io/reviews/apache/spark/5001)
<!-- Reviewable:end -->

Author: Cheng Lian <lian@databricks.com>

Closes #5001 from liancheng/parquet-doc and squashes the following commits:

89ad3db [Cheng Lian] Addresses @rxin's comments
7eb6955 [Cheng Lian] Docs for the new Parquet data source
415eefb [Cheng Lian] Some minor formatting improvements

(cherry picked from commit 69ff8e8)
Signed-off-by: Cheng Lian <lian@databricks.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
4 participants
@liancheng @SparkQA @AmplabJenkins @rxin