[Docs] Add/update model monitoring

[jillnogold]

No description provided.

[review-notebook-app]

Check out this pull request on 

See visual diffs & provide feedback on Jupyter Notebooks.

---

Powered by ReviewNB

[amit-elbaz]

Hi, I wanted to add that this PR looks great, the documentation is very detailed about all the capabilities of the model monitoring!

However, I think that we miss some examples of applications that can be used in the new model monitoring. Since the new model monitoring is based on user defined applications, it will be helpful to provide some examples that show how the application function should look like (it needs to have fixed parameters and return some fixed values).
I will add 2 examples notebook that I used when I was asked to test it. Feel free to use any part of it or take inspiration from them. Just note that:

• One notebook uses Evidently in the application function to perform the model monitoring.
• The second one also uses Evidently in the application function, but it tested how to monitor LLM models. So the Evidently monitoring is more 'basic' as we just wanted to test if there is a way to monitor 'text' data since it's LLM. The notebook also contains some workaround that is the process of being solved (or maybe it's already solved) - it logs a 'dummy' model to create a model endpoint. This won't be needed in the future.

If you need any more info about the new model monitoring and the applications- I can try to help but @Eyal-Danieli is the address

Examples in here https://mckinsey.box.com/s/r8ovuiu8bywtkdq2kfqpeqln9lfswqzy

[jillnogold]

@amit-elbaz Are your comments all relevant to v1.6? I want to get the first updates out soon, and then update for 1.7.
Thanks

[amit-elbaz]

@jillnogold I think this starts in 1.7. @Eyal-Danieli Can you confirm?

[Eyal-Danieli]

a single comment