diff --git a/docs/configuration.md b/docs/configuration.md index 64066bc0d70cd..0de824546c751 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -1474,6 +1474,13 @@ Apart from these, the following properties are also available, and may be useful the new Kafka direct stream API. + + spark.streaming.ui.retainedBatches + 1000 + + How many batches the Spark Streaming UI and status APIs remember before garbage collecting. + + #### Cluster Managers