Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-23259][SQL] Clean up legacy code around hive external catalog and HiveClientImpl #20425

Closed
wants to merge 1 commit into from
Closed

[SPARK-23259][SQL] Clean up legacy code around hive external catalog and HiveClientImpl #20425

wants to merge 1 commit into from

Conversation

liufengdb
Copy link

@liufengdb liufengdb commented Jan 29, 2018

What changes were proposed in this pull request?

Three legacy statements are removed by this patch:

  • in HiveExternalCatalog: The withClient wrapper is not necessary for the private method getRawTable.

  • in HiveClientImpl: The statement runSqlHive() is not necessary for the addJar method, after the jar being added to the single class loader.

  • in HiveClientImpl: There are some redundant code in both the tableExists and getTableOption method.

How was this patch tested?

Existing tests

Please review http://spark.apache.org/contributing.html before opening a pull request.

@liufengdb liufengdb changed the title [WIP] remove the redundant code in HiveExternalCatlog and HiveClientImpl [SPARK-23259][SQL] Clean up legacy code around hive external catalog and HiveClientImpl Jan 29, 2018
@SparkQA
Copy link

SparkQA commented Jan 29, 2018

Test build #86777 has finished for PR 20425 at commit 41829e4.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@@ -817,7 +821,6 @@ private[hive] class HiveClientImpl(
uri.toURL
}
clientLoader.addJar(jarURL)
runSqlHive(s"ADD JAR $path")
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let us create a separate PR for this line? The others look good to me.

@HyukjinKwon
Copy link
Member

HyukjinKwon commented Jul 16, 2018

I opened a PR addressing @gatorsmile's comments above since the author looks inactive.

@asfgit asfgit closed this in d57a267 Jul 17, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
4 participants