Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[SPARK-6969][SQL] Refresh the cached table when REFRESH TABLE is used #5583

Closed
wants to merge 3 commits into from
Closed

[SPARK-6969][SQL] Refresh the cached table when REFRESH TABLE is used #5583

wants to merge 3 commits into from

Conversation

yhuai
Copy link
Contributor

@yhuai yhuai commented Apr 20, 2015

@SparkQA
Copy link

SparkQA commented Apr 20, 2015

Test build #30570 has finished for PR 5583 at commit 92b2498.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.
  • This patch does not change any dependencies.

marmbrus
marmbrus reviewed Apr 20, 2015
View reviewed changes
sql/core/src/main/scala/org/apache/spark/sql/sources/ddl.scala

// If this table is cached as a InMemoryColumnarRelation, drop the original
// cached version and make the new version cached lazily.
val logicalPlan = sqlContext.catalog.lookupRelation(Seq(databaseName, tableName))
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Leave a TODO here to clean this up when uncacheTable supports databases correctly.

@SparkQA
Copy link

SparkQA commented Apr 21, 2015

Test build #30618 has finished for PR 5583 at commit 1e5142b.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.
  • This patch does not change any dependencies.

@marmbrus
Copy link
Contributor

Thanks, merged to master.

@asfgit asfgit closed this in 6265cba Apr 21, 2015
nemccarthy pushed a commit to nemccarthy/spark that referenced this pull request Jun 19, 2015
@yhuai @nemccarthy
[SPARK-6969][SQL] Refresh the cached table when REFRESH TABLE is used
1c86ed5 
https://issues.apache.org/jira/browse/SPARK-6969

Author: Yin Huai <yhuai@databricks.com>

Closes apache#5583 from yhuai/refreshTableRefreshDataCache and squashes the following commits:

1e5142b [Yin Huai] Add todo.
92b2498 [Yin Huai] Minor updates.
367df92 [Yin Huai] Recache data in the command of REFRESH TABLE.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
3 participants
@yhuai @SparkQA @marmbrus