Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: model status API for kserve #1773

Merged
merged 13 commits into from
Sep 21, 2022

Conversation

jagadeeshi2i
Copy link
Collaborator

@jagadeeshi2i jagadeeshi2i commented Jul 28, 2022

Signed-off-by: jagadeesh jagadeeshj@ideas2it.com

Description

fixes: kserve/kserve-1915

Issue: kserve model status API returns ready status only after a predict request as model is not loaded in startup.
Soln: Loads all TS models at start with load_models property and kserve load model method.

Gif of model status working after TS isvc deployment.
output
model-status.log

Type of change

Please delete options that are not relevant.

  • Bug fix (non-breaking change which fixes an issue)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • New feature (non-breaking change which adds functionality)
  • This change requires a documentation update

Feature/Issue validation/testing

Please describe the Unit or Integration tests that you ran to verify your changes and relevant result summary. Provide instructions so it can be reproduced.
Please also list any relevant details for your test configuration.

  • Test A
    Logs for Test A

  • Test B
    Logs for Test B

Checklist:

  • Did you have fun?
  • Have you added tests that prove your fix is effective or that this feature works?
  • Has code been commented, particularly in hard-to-understand areas?
  • Have you made corresponding changes to the documentation?

Signed-off-by: jagadeesh <jagadeeshj@ideas2it.com>
@codecov
Copy link

codecov bot commented Jul 28, 2022

Codecov Report

Merging #1773 (139f65b) into master (7fef9d2) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master    #1773   +/-   ##
=======================================
  Coverage   45.19%   45.19%           
=======================================
  Files          64       64           
  Lines        2604     2604           
  Branches       60       60           
=======================================
  Hits         1177     1177           
  Misses       1427     1427           

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

Signed-off-by: jagadeesh <jagadeeshj@ideas2it.com>
@jagadeeshi2i jagadeeshi2i changed the title [WIP] fix: model status API for kserve fix: model status API for kserve Jul 29, 2022
@msaroufim
Copy link
Member

@jagadeeshi2i Windows CI is known to flake so CI is all green
Screen Shot 2022-08-08 at 9 29 24 AM

@maaquib maaquib requested a review from chauhang August 11, 2022 22:58
Signed-off-by: jagadeesh <jagadeeshj@ideas2it.com>
Signed-off-by: jagadeesh <jagadeeshj@ideas2it.com>
Signed-off-by: jagadeesh <jagadeeshj@ideas2it.com>
Copy link
Collaborator

@agunapal agunapal left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me

@agunapal agunapal merged commit 3c4ee71 into pytorch:master Sep 21, 2022
jagadeeshi2i added a commit to jagadeeshi2i/serve that referenced this pull request Nov 1, 2022
* fix: model status API for kserve
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Model status is not ready until first request is received
4 participants