Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-15977][SQL] Fix TRUNCATE TABLE for Spark specific datasource tables #13697

Closed
wants to merge 3 commits into from

Conversation

hvanhovell
Copy link
Contributor

What changes were proposed in this pull request?

TRUNCATE TABLE is currently broken for Spark specific datasource tables (json, csv, ...). This PR correctly sets the location for these datasources which allows them to be truncated.

How was this patch tested?

Extended the datasources TRUNCATE TABLE tests in DDLSuite.

@hvanhovell
Copy link
Contributor Author

cc @andrewor14

@andrewor14
Copy link
Contributor

LGTM

@SparkQA
Copy link

SparkQA commented Jun 16, 2016

Test build #60617 has finished for PR 13697 at commit 765be24.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Jun 16, 2016

Test build #3116 has finished for PR 13697 at commit 765be24.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Jun 16, 2016

Test build #60633 has finished for PR 13697 at commit 59dfab9.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@andrewor14
Copy link
Contributor

new changes also LGTM. It's weird that we just implicitly assume the location must be None for data source tables without any comments there, but that's a separate issue.

@hvanhovell
Copy link
Contributor Author

Merging to master/2.0 - thanks for the review!

asfgit pushed a commit that referenced this pull request Jun 16, 2016
…ables

## What changes were proposed in this pull request?
`TRUNCATE TABLE` is currently broken for Spark specific datasource tables (json, csv, ...). This PR correctly sets the location for these datasources which allows them to be truncated.

## How was this patch tested?
Extended the datasources `TRUNCATE TABLE` tests in `DDLSuite`.

Author: Herman van Hovell <hvanhovell@databricks.com>

Closes #13697 from hvanhovell/SPARK-15977.

(cherry picked from commit f9bf15d)
Signed-off-by: Herman van Hovell <hvanhovell@databricks.com>
@asfgit asfgit closed this in f9bf15d Jun 16, 2016
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
3 participants