Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Sample doc for custom model server using multi-model serving #1590

Open
Aaronchoo opened this issue May 2, 2021 · 2 comments
Open

Sample doc for custom model server using multi-model serving #1590

Aaronchoo opened this issue May 2, 2021 · 2 comments

Comments

@Aaronchoo
Copy link
Contributor

Aaronchoo commented May 2, 2021

/kind feature

Describe the solution you'd like
[A clear and concise description of what you want to happen.]
Add a sample of MMS using a custom model server similar to sklearn and triton that will reside in the same directory.

Anything else you would like to add:
[Miscellaneous information that will assist in solving the issue.]
This should include how to specify supported framework and how to set protocol and multi-model server ref.

@molejnik-mergebit
Copy link

+1 on this, I would really appreciate some docs as this is not clear in kserve 0.8.0 how to get multi model serving to work

@Samjoel3101
Copy link

Samjoel3101 commented Feb 20, 2023

Hi , I am new here would love to work on this documentation I have just started to explore the multi model serving part of kserve. Would love to explore this further and work on the documentation of this if I get the chance. @yuzisun @Aaronchoo

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

6 participants