Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

cases: Model Registries #3333

Merged
merged 68 commits into from
May 20, 2022
Merged

cases: Model Registries #3333

merged 68 commits into from
May 20, 2022

Conversation

jorgeorpinel
Copy link
Contributor

@jorgeorpinel jorgeorpinel commented Mar 3, 2022

Per #2544

4.2 ML Model Registry
Model lifecycle (training, shadow, active, inactive)
Automated/Continuous training (remotely)
Discovery and reusability
Deploying models
Batch scoring example
+ Real-time inference

Review app page: https://dvcorg-casesmodelregistry.gtsb.io/doc/use-cases/model-registry

@shcheklein shcheklein temporarily deployed to dvc-org-cases-model-reg-zxshlp March 3, 2022 19:18 Inactive
@jorgeorpinel jorgeorpinel temporarily deployed to dvc-org-cases-model-reg-zxshlp March 3, 2022 19:19 Inactive
@jorgeorpinel jorgeorpinel self-assigned this Mar 3, 2022
@jorgeorpinel jorgeorpinel temporarily deployed to dvc-org-cases-model-reg-zxshlp March 3, 2022 19:30 Inactive
@jorgeorpinel jorgeorpinel temporarily deployed to dvc-org-cases-model-reg-zxshlp March 4, 2022 18:39 Inactive
@jorgeorpinel jorgeorpinel temporarily deployed to dvc-org-cases-model-reg-zxshlp March 4, 2022 19:08 Inactive
@jorgeorpinel jorgeorpinel temporarily deployed to dvc-org-cases-model-reg-zxshlp March 10, 2022 17:22 Inactive
@jorgeorpinel jorgeorpinel temporarily deployed to dvc-org-cases-model-reg-zxshlp March 10, 2022 17:27 Inactive
@jorgeorpinel jorgeorpinel temporarily deployed to dvc-org-cases-model-reg-zxshlp March 13, 2022 02:17 Inactive
@jorgeorpinel jorgeorpinel temporarily deployed to dvc-org-cases-model-reg-zxshlp March 18, 2022 07:23 Inactive
@jorgeorpinel jorgeorpinel temporarily deployed to dvc-org-cases-model-reg-zxshlp March 25, 2022 19:10 Inactive
@jorgeorpinel jorgeorpinel temporarily deployed to dvc-org-cases-model-reg-zxshlp March 30, 2022 05:08 Inactive
@jorgeorpinel jorgeorpinel added the p1-important Active priorities to deal within next sprints label Mar 30, 2022
@jorgeorpinel
Copy link
Contributor Author

jorgeorpinel commented May 13, 2022

+ update the image

@shcheklein do you mean properly designed? That may take some time. Meanwhile we could iterate on it (here's an idea) and publish a provisional one.

@shcheklein
Copy link
Member

@jorgeorpinel let's iterate then, the one from the idea - you mentioned that it's more like a second image, it's bit too low level for the first one I think

And to **package** the models, you can save them with [MLEM] in your Python
training code. It automagically captures all the context needed to deploy them,
and saves it to the repo. It can save your model files in cloud storage (by
itself or with DVC), list and transfer them among locations, or even serve them
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I still miss more clear indication that MLEM helps you use your model downstream. Pack it, deploy it. But since this is the page about MR, maybe that's ok.

Copy link
Contributor Author

@jorgeorpinel jorgeorpinel May 18, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah this paragraph improves with my understanding of MLEM. Reviewing mlem.ai/doc contents has helped 😋 . I rephrased it again, PTAL @aguschin .

@shcheklein shcheklein added A: docs Area: user documentation (gatsby-theme-iterative) C: cases Content of /doc/use-cases labels May 18, 2022
@jorgeorpinel

This comment was marked as resolved.

@shcheklein
Copy link
Member

@jorgeorpinel good, but looks too complicated now ... can we simplify it significantly (less arrows, may be less icons here and there, etc?)

@jorgeorpinel
Copy link
Contributor Author

I rearranged things a little both with the figure (much simpler now) and benefits list + Added some links and admons (d6d01c6).

Please the latest https://dvcorg-casesmodelregistry.gtsb.io/doc/use-cases/model-registry

@shcheklein
Copy link
Member

@jorgeorpinel it looks great! way simpler, I think we are ready to merge and then ask folks to re-draw it if needed.

@shcheklein
Copy link
Member

Good stuff 🎉

@jorgeorpinel jorgeorpinel merged commit 64d782b into master May 20, 2022
@jorgeorpinel jorgeorpinel deleted the cases/model-registry branch May 20, 2022 01:49
@jorgeorpinel
Copy link
Contributor Author

There is a "pretty" version of the image but not really improved in terms of the design, so I'm not publishing it yet. Just for the record:

image

@jorgeorpinel
Copy link
Contributor Author

jorgeorpinel commented May 21, 2022

Also should we link to/from https://iterative.ai/model-registry ? I just found out about that page!

@jorgeorpinel jorgeorpinel added A: docs Area: user documentation (gatsby-theme-iterative) and removed A: docs Area: user documentation (gatsby-theme-iterative) labels Mar 16, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A: docs Area: user documentation (gatsby-theme-iterative) C: cases Content of /doc/use-cases p1-important Active priorities to deal within next sprints
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants