Skip to content

Conversation

@cloud-fan
Copy link
Contributor

@cloud-fan cloud-fan commented Nov 6, 2017

What changes were proposed in this pull request?

spark.sql.statistics.autoUpdate.size should be spark.sql.statistics.size.autoUpdate.enabled. The previous name is confusing as users may treat it as a size config.

This config is in master branch only, no backward compatibility issue.

How was this patch tested?

N/A

@cloud-fan
Copy link
Contributor Author

cc @wzhfy @gatorsmile

@SparkQA
Copy link

SparkQA commented Nov 6, 2017

Test build #83482 has finished for PR 19667 at commit 75c11c8.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@@ -812,8 +812,8 @@ object SQLConf {
.doubleConf
.createWithDefault(0.05)

val AUTO_UPDATE_SIZE =
buildConf("spark.sql.statistics.autoUpdate.size")
val AUTO_UPDATE_ENABLED =
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How about AUTO_UPDATE_SIZE_ENABLED? If we support auto update other stats (needs table scan in addition to just looking up file length) in the future, we may need another config.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

AUTO_SIZE_UPDATE_ENABLED

@SparkQA
Copy link

SparkQA commented Nov 7, 2017

Test build #83537 has finished for PR 19667 at commit 55b949e.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@gatorsmile
Copy link
Member

LGTM

Thanks! Merged to master

@asfgit asfgit closed this in d520225 Nov 7, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants