Skip to content

Commit

Permalink
[MINOR][CORE] Quiet request executor remove message
Browse files Browse the repository at this point in the history
### What changes were proposed in this pull request?

Settings to quiet for Class `ExecutorAllocationManager` that request message too verbose. otherwise, this class generates too many messages like
`INFO spark.ExecutorAllocationManager: Request to remove executorIds: 890`
 when we enabled DRA.

### Why are the changes needed?

Log level improvement.

### Does this PR introduce any user-facing change?

No

### How was this patch tested?

Closes apache#26925 from cfmcgrady/quiet-request-executor-remove-message.

Authored-by: Fu Chen <cfmcgrady@gmail.com>
Signed-off-by: Sean Owen <srowen@gmail.com>
  • Loading branch information
cfmcgrady authored and srowen committed Dec 26, 2019
1 parent 59c014e commit 3584d84
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -423,7 +423,7 @@ private[spark] class ExecutorAllocationManager(
private def removeExecutors(executors: Seq[String]): Seq[String] = synchronized {
val executorIdsToBeRemoved = new ArrayBuffer[String]

logInfo("Request to remove executorIds: " + executors.mkString(", "))
logDebug(s"Request to remove executorIds: ${executors.mkString(", ")}")
val numExistingExecutors = executorMonitor.executorCount - executorMonitor.pendingRemovalCount

var newExecutorTotal = numExistingExecutors
Expand Down

0 comments on commit 3584d84

Please sign in to comment.