feat: Add scheduler scoringStrategy Helm value for GPU spread

[pre]

Summary

• Expose scheduler.scoringStrategy in the operator chart values so the NodeResourcesFit GPU scoring can switch between bin-pack and spread without a code change.
• Default is RequestedToCapacityRatio (bin-pack), which reproduces current behavior exactly. Set to LeastAllocated to spread GPU workloads across nodes.
• config/static/scheduler/* is left untouched (non-Helm default stays bin-pack).

Why

For the AMD Advancing AI demo on MI350X nodes we want GPU workloads spread across nodes rather than bin-packed next to each other (heat/locality). This adds a values toggle so deployments (e.g. via GitOps values override) can pick the spread strategy without waiting on a code change.

Implementation

chart/templates/scheduler.yaml includes the raw scheduler-resources.yaml ConfigMap via .Files.Get. When scheduler.scoringStrategy=LeastAllocated, the template rewrites the RequestedToCapacityRatio block to LeastAllocated (same GPU resource weights). Uses backtick raw strings for readability.

Test plan

• helm template . renders bin-pack by default (identical to current main)
• helm template . --set scheduler.scoringStrategy=LeastAllocated renders type: LeastAllocated
• Full chart render valid in both modes
• Deploy to a cluster and confirm kaiwo-scheduler-config ConfigMap reflects the selected strategy (kube-scheduler needs a rollout restart, no hot-reload)

Note: this is node-level spread only. Intra-node GPU/PCIe placement is out of scope (would need the DRA driver).

🤖 Generated with Claude Code

[pre]

Tested in a two node MI350X cluster (further testing will be done later when more nodes available):

• With default RequestedToCapacityRatio GPU workloads prefer to fill a single node first, while the other one is idle.
• With LeastAllocated GPU workloads are spread among the two nodes.

[salexo]

Thanks! Looks good, just one change request, we could try to fail fast on unknown values, for example

{{- $strategy := .Values.scheduler.scoringStrategy }}
{{- if not (or (eq $strategy "RequestedToCapacityRatio") (eq $strategy "LeastAllocated")) }}
{{- fail (printf "scheduler.scoringStrategy must be RequestedToCapacityRatio or LeastAllocated, got %q" $strategy) }}
{{- end }}

[pre]

@salexo how about now?

[salexo]

LGTM!