Performance improvement

[william-wang]

What would you like to be added:

Optimize the controllers and schedulers components to improve the performence from end to end for high performance workload.

Why is this needed:

More and more workloads are being migrated to Kubernetes on Volcano, Some workloads have higher requirements for high throughput and low latency, e.g bilibili requires best qps for vedio transcoding from job created to pod running.

sub-tasks

• Controller
• Scheduler

[Monokaix]

Controller related:

• Avoid unnecessary API update and re-enqueue action #3490
• Add controller switch params. #3485
• [Performance issue] All controllers should use sharedInformerFactory #3484
• [Performance issue] Replace reflect.DeepEqural with quality.Semantic.DeepEqual #3488

[lowang-bh]

Scheduler related:

allocate action:

• It's better to check and skip allocation for job when it is poped #3047
• cache feasible nodes for a job's tasks #3492
• record the norminated node for pod and consider it first in next cycle #3491

preempt action:

• filterout those nodes which are not helpful for preemptation #3071

[Monokaix]

Issues also need to concern about volcano controller:
#3601
#3597