Create a kserve auxillary controller to manage extra resources for LLM serving

[VedantMahabaleshwarkar]

We need a auxiliary controller for the LLM Serving stack. The needs for this controller might evolve over time but currently are as follows :

• Define how we filter for LLM Serving model namespaces
  • Maybe some NS annotation similar to modelmesh
• Watch LLM Serving enabled namespaces
  • Create SMMR and PeerAuthentication resources for the namespace when a new NS is detected with LLM Serving enabled.
  • Clean up SMMR and PeerAuthentication resources if NS is deleted / LLM Serving label is removed

[VedantMahabaleshwarkar]

The auxillary controller will be odh-model-controller and it will be separated from it's current deployment structure (which is an overlay to modelmesh).

[VedantMahabaleshwarkar]

The initial cut for the controller was created here : https://github.com/VedantMahabaleshwarkar/odh-model-controller/tree/kserve-metrics

On 8/4 new requirements for monitoring were added. See Req 7 in the Requirements Doc

These new requirements mean that the overall monitoring solution changes from Option A to Option C as described in this doc

The change in logic for the controller corresponding the the change from Option A to Option C is currently in progress

[VedantMahabaleshwarkar]

#65