Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[SPARK-5193][SQL] Tighten up SQLContext API #4049

Closed
wants to merge 3 commits into from
Closed

[SPARK-5193][SQL] Tighten up SQLContext API #4049

wants to merge 3 commits into from

Conversation

rxin
Copy link
Contributor

@rxin rxin commented Jan 14, 2015

  1. Removed 2 implicits (logicalPlanToSparkQuery and baseRelationToSchemaRDD)
  2. Moved extraStrategies into ExperimentalMethods.
  3. Made private methods protected[sql] so they don't show up in javadocs.
  4. Removed createParquetFile.
  5. Added Java version of applySchema to SQLContext.

@rxin
[SPARK-5193][SQL] Tighten up SQLContext API
4a38c9b 
1. Removed 2 implicits (logicalPlanToSparkQuery and baseRelationToSchemaRDD)
2. Moved extraStrategies into ExperimentalMethods.
3. Made private methods protected[sql] so they don't show up in javadocs.
@SparkQA
Copy link

SparkQA commented Jan 14, 2015

Test build #25564 has started for PR 4049 at commit 4a38c9b.

  • This patch merges cleanly.

@SparkQA
Copy link

SparkQA commented Jan 14, 2015

Test build #25564 has finished for PR 4049 at commit 4a38c9b.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):
    • class ExperimentalMethods protected[sql](sqlContext: SQLContext)

@AmplabJenkins
Copy link

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/25564/
Test PASSed.

@SparkQA
Copy link

SparkQA commented Jan 15, 2015

Test build #25583 has started for PR 4049 at commit ecd6685.

  • This patch merges cleanly.

@SparkQA
Copy link

SparkQA commented Jan 15, 2015

Test build #25584 has started for PR 4049 at commit a326a1a.

  • This patch merges cleanly.

@rxin
Copy link
Contributor Author

rxin commented Jan 15, 2015

@marmbrus this is ready for review.

@SparkQA
Copy link

SparkQA commented Jan 15, 2015

Test build #25583 has finished for PR 4049 at commit ecd6685.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):
    • class ExperimentalMethods protected[sql](sqlContext: SQLContext)

@AmplabJenkins
Copy link

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/25583/
Test PASSed.

@SparkQA
Copy link

SparkQA commented Jan 15, 2015

Test build #25584 has finished for PR 4049 at commit a326a1a.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):
    • class ExperimentalMethods protected[sql](sqlContext: SQLContext)

@AmplabJenkins
Copy link

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/25584/
Test PASSed.

@asfgit asfgit closed this in cfa397c Jan 15, 2015
@rxin rxin mentioned this pull request Jan 16, 2015
Closed
asfgit pushed a commit that referenced this pull request Jan 17, 2015
@rxin
[SPARK-5193][SQL] Remove Spark SQL Java-specific API.
61b427d 
After the following patches, the main (Scala) API is now usable for Java users directly.

#4056
#4054
#4049
#4030
#3965
#3958

Author: Reynold Xin <rxin@databricks.com>

Closes #4065 from rxin/sql-java-api and squashes the following commits:

b1fd860 [Reynold Xin] Fix Mima
6d86578 [Reynold Xin] Ok one more attempt in fixing Python...
e8f1455 [Reynold Xin] Fix Python again...
3e53f91 [Reynold Xin] Fixed Python.
83735da [Reynold Xin] Fix BigDecimal test.
e9f1de3 [Reynold Xin] Use scala BigDecimal.
500d2c4 [Reynold Xin] Fix Decimal.
ba3bfa2 [Reynold Xin] Updated javadoc for RowFactory.
c4ae1c5 [Reynold Xin] [SPARK-5193][SQL] Remove Spark SQL Java-specific API.
andmarios pushed a commit to andmarios/spark-examples that referenced this pull request Mar 20, 2015
@rxin
[SPARK-5193][SQL] Remove Spark SQL Java-specific API.
3364cc8 
After the following patches, the main (Scala) API is now usable for Java users directly.

apache/spark#4056
apache/spark#4054
apache/spark#4049
apache/spark#4030
apache/spark#3965
apache/spark#3958

Author: Reynold Xin <rxin@databricks.com>

Closes #4065 from rxin/sql-java-api and squashes the following commits:

b1fd860 [Reynold Xin] Fix Mima
6d86578 [Reynold Xin] Ok one more attempt in fixing Python...
e8f1455 [Reynold Xin] Fix Python again...
3e53f91 [Reynold Xin] Fixed Python.
83735da [Reynold Xin] Fix BigDecimal test.
e9f1de3 [Reynold Xin] Use scala BigDecimal.
500d2c4 [Reynold Xin] Fix Decimal.
ba3bfa2 [Reynold Xin] Updated javadoc for RowFactory.
c4ae1c5 [Reynold Xin] [SPARK-5193][SQL] Remove Spark SQL Java-specific API.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
3 participants
@rxin @SparkQA @AmplabJenkins