Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-13187][SQL] Add boolean/long/double options in DataFrameReader/Writer #11072

Closed
wants to merge 2 commits into from

Conversation

rxin
Copy link
Contributor

@rxin rxin commented Feb 4, 2016

This patch adds option function for boolean, long, and double types. This makes it slightly easier for Spark users to specify options without turning them into strings. Using the JSON data source as an example.

Before this patch:

sqlContext.read.option("primitivesAsString", "true").json("/path/to/json")

After this patch:
Before this patch:

sqlContext.read.option("primitivesAsString", true).json("/path/to/json")

@rxin
Copy link
Contributor Author

rxin commented Feb 4, 2016

cc @marmbrus

@SparkQA
Copy link

SparkQA commented Feb 4, 2016

Test build #2518 has finished for PR 11072 at commit e1e0870.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Feb 4, 2016

Test build #50774 has finished for PR 11072 at commit e453b59.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@zsxwing
Copy link
Member

zsxwing commented Feb 5, 2016

LGTM

@rxin
Copy link
Contributor Author

rxin commented Feb 5, 2016

Thanks - merging in master.

@asfgit asfgit closed this in 82d84ff Feb 5, 2016
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
3 participants