Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create InferenceService Model puller sidecar #1040

Closed
yuzliu opened this issue Aug 23, 2020 · 2 comments · Fixed by #989
Closed

Create InferenceService Model puller sidecar #1040

yuzliu opened this issue Aug 23, 2020 · 2 comments · Fixed by #989

Comments

@yuzliu
Copy link
Contributor

yuzliu commented Aug 23, 2020

Create an InferenceService model puller sidecar which listens for the model configmap create/delete/update events

Acceptance criterias

  • Implement with golang so it can be merged with other KFServing sidecar
  • Mount the model config into the sidecar container and compute the difference for model config for each create/delete/update event and log load/unload xxx models according to the changes
  • Not need to call real load/unload endpoint yet.
  • Unit tests but no deployment included
@issue-label-bot
Copy link

Issue-Label Bot is automatically applying the labels:

Label Probability
kind/feature 0.91

Please mark this comment with 👍 or 👎 to give our bot feedback!
Links: app homepage, dashboard and code for this bot.

@issue-label-bot
Copy link

Issue-Label Bot is automatically applying the labels:

Label Probability
area/engprod 0.60

Please mark this comment with 👍 or 👎 to give our bot feedback!
Links: app homepage, dashboard and code for this bot.

@yuzliu yuzliu changed the title Create Model puller sidecar Create InferenceService Model puller sidecar Aug 23, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants