[CELEBORN-1758] Remove the empty user resource consumption from worker heartbeat

[turboFei]

What changes were proposed in this pull request?

1. report the resourceConsumptionSnapshot from storageManager directly in the worker heartbeat, which does not contain the empty user resource consumption
2. For RESTful API, do not return the empty user resource consumption as well.

Why are the changes needed?

celeborn/common/src/main/scala/org/apache/celeborn/common/meta/WorkerInfo.scala

Lines 239 to 248 in 878a83c

	def updateThenGetUserResourceConsumption(resourceConsumptions: util.Map[
	UserIdentifier,
	ResourceConsumption]): util.Map[UserIdentifier, ResourceConsumption] = {
	userResourceConsumption.keys().asScala.filterNot(resourceConsumptions.containsKey).foreach {
	identifier =>
	userResourceConsumption.put(identifier, ResourceConsumption(0, 0, 0, 0))
	}
	userResourceConsumption.putAll(resourceConsumptions)
	userResourceConsumption
	}

Currently, we never remove the user resource consumption even the sub resource consumptions is empty, and create a ResourceConsumption(0, 0, 0, 0) instead.

I am afraid that, the worker will report more and more empty user resource consumption to master, once one of their slots assigned to this worker.

Likes:

So, I think we just need to report the resourceConsumptionSnapshot from storageManager directly, which does not contain the empty user resource consumption.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

GA.

[FMX]

LGTM. After checking all related codes, this PR won't introduce trouble. But I'll leave this PR for others to merge.

[SteNicholas]

LGTM.

[SteNicholas]

Merged to main(v0.6.0).