Skip to content

Commit

Permalink
[SPARK-24157][SS][FOLLOWUP] Rename to spark.sql.streaming.noDataMicro…
Browse files Browse the repository at this point in the history
…Batches.enabled

## What changes were proposed in this pull request?
This patch changes the config option `spark.sql.streaming.noDataMicroBatchesEnabled` to `spark.sql.streaming.noDataMicroBatches.enabled` to be more consistent with rest of the configs. Unfortunately there is one streaming config called `spark.sql.streaming.metricsEnabled`. For that one we should just use a fallback config and change it in a separate patch.

## How was this patch tested?
Made sure no other references to this config are in the code base:
```
> git grep "noDataMicro"
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala:    buildConf("spark.sql.streaming.noDataMicroBatches.enabled")
```

Closes #22476 from rxin/SPARK-24157.

Authored-by: Reynold Xin <rxin@databricks.com>
Signed-off-by: Reynold Xin <rxin@databricks.com>
  • Loading branch information
rxin committed Sep 20, 2018
1 parent 90e3955 commit 936c920
Showing 1 changed file with 1 addition and 1 deletion.
Expand Up @@ -1076,7 +1076,7 @@ object SQLConf {
.createWithDefault(10000L)

val STREAMING_NO_DATA_MICRO_BATCHES_ENABLED =
buildConf("spark.sql.streaming.noDataMicroBatchesEnabled")
buildConf("spark.sql.streaming.noDataMicroBatches.enabled")
.doc(
"Whether streaming micro-batch engine will execute batches without data " +
"for eager state management for stateful streaming queries.")
Expand Down

0 comments on commit 936c920

Please sign in to comment.