[SPARK-32600][CORE] Unify task name in some logs between driver and executor

[Ngone51]

What changes were proposed in this pull request?

This PR replaces some arbitrary task names in logs with the widely used task name (e.g. "task 0.0 in stage 1.0 (TID 1)") among driver and executor. This will change the task name in TaskDescription by appending TID.

Why are the changes needed?

Some logs are still using TID(a.k.a taskId) only as the task name, e.g.,

spark/core/src/main/scala/org/apache/spark/executor/Executor.scala

Line 786 in 7f275ee

logWarning(s"Thread dump from task $taskId:\n${thread.stackTrace}")

spark/core/src/main/scala/org/apache/spark/executor/Executor.scala

Lines 632 to 635 in 7f275ee

	logWarning(s"TID ${taskId} encountered a ${fetchFailedCls} and " +
	s"failed, but the ${fetchFailedCls} was hidden by another " +
	s"exception. Spark is handling this like a fetch failure and ignoring the " +
	s"other exception: $t")

And the task thread name also only has the taskId:

spark/core/src/main/scala/org/apache/spark/executor/Executor.scala

Line 325 in 7f275ee

val threadName = s"Executor task launch worker for task $taskId"

As mentioned in #1259, TID itself does not capture stage or retries, making it harder to correlate with the application. It's inconvenient when debugging applications.

Actually, task name like "task name (e.g. "task 0.0 in stage 1.0 (TID 1)")" has already been used widely after #1259. We'd better follow the naming convention.

Does this PR introduce any user-facing change?

Yes. Users will see the more consistent task names in the log.

How was this patch tested?

Manually checked.

[Ngone51]

@jiangxb1987 @tgravescs @squito Please take a look, thanks!

[SparkQA]

Test build #127377 has finished for PR 29418 at commit ade4c9e.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[Ngone51]

@jiangxb1987 @tgravescs please help review, thanks!

[jiangxb1987]

LGTM

[jiangxb1987]

retest this please

[SparkQA]

Test build #127603 has finished for PR 29418 at commit ade4c9e.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[cloud-fan]

thanks, merging to master!

[Ngone51]

thanks all!!