Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[MINOR][SQL] Avoid hardcoded configuration keys in SQLConf's doc #22877

Closed
wants to merge 2 commits into from

Conversation

HyukjinKwon
Copy link
Member

What changes were proposed in this pull request?

This PR proposes to avoid hardcorded configuration keys in SQLConf's `doc.

How was this patch tested?

Manually verified.

@SparkQA
Copy link

SparkQA commented Oct 29, 2018

Test build #98209 has finished for PR 22877 at commit 5995570.

  • This patch fails to build.
  • This patch merges cleanly.
  • This patch adds no public classes.

@@ -408,15 +408,16 @@ object SQLConf {

val PARQUET_FILTER_PUSHDOWN_DATE_ENABLED = buildConf("spark.sql.parquet.filterPushdown.date")
.doc("If true, enables Parquet filter push-down optimization for Date. " +
"This configuration only has an effect when 'spark.sql.parquet.filterPushdown' is enabled.")
s"This configuration only has an effect when '${PARQUET_FILTER_PUSHDOWN_ENABLED.key}' is " +
Copy link
Member

@kiszk kiszk Oct 29, 2018

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: Can we apply the same policy to other places, too?
'spark.sql.optimizer.planChangeLog.level' at L182
spark.sql.parquet.compression.codec at L397
spark.sql.orc.compression.codec at L493

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi, @kiszk . Those instances are impossible. We cannot use the value during defining the configuration.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Got it, thanks

@SparkQA
Copy link

SparkQA commented Oct 29, 2018

Test build #98214 has finished for PR 22877 at commit d641209.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@HyukjinKwon
Copy link
Member Author

Merged to master

@HyukjinKwon
Copy link
Member Author

Thanks, @kiszk and @dongjoon-hyun

@asfgit asfgit closed this in 5bd5e1b Oct 29, 2018
jackylee-ch pushed a commit to jackylee-ch/spark that referenced this pull request Feb 18, 2019
## What changes were proposed in this pull request?

This PR proposes to avoid hardcorded configuration keys in SQLConf's `doc.

## How was this patch tested?

Manually verified.

Closes apache#22877 from HyukjinKwon/minor-conf-name.

Authored-by: hyukjinkwon <gurwls223@apache.org>
Signed-off-by: hyukjinkwon <gurwls223@apache.org>
@HyukjinKwon HyukjinKwon deleted the minor-conf-name branch March 3, 2020 01:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
4 participants