Skip to content

Add support for ONNX and TF predictor types on AsyncAPI #1996

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 9 commits into from
Mar 25, 2021

Conversation

miguelvr
Copy link
Collaborator

@miguelvr miguelvr commented Mar 24, 2021

closes #1980


checklist:

  • run make test and make lint
  • test manually (i.e. build/push all images, restart operator, and re-deploy APIs)
  • update examples
  • update docs and add any new files to summary.md (view in gitbook after merging)

Copy link
Member

@RobertLucian RobertLucian left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! Just one nit.

)
}

if api.Predictor.Type != userconfig.PythonPredictorType || api.Predictor.MultiModelReloading != nil {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

MultiModelReloading is not permitted for the async API anyway, so I think we can remove the 2nd check. That's because MultiModeReloading only belongs to the python type.

@miguelvr miguelvr merged commit 5dc5c43 into master Mar 25, 2021
@miguelvr miguelvr deleted the feature/async-predictor-types branch March 25, 2021 09:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Support other predictor kinds for AsyncAPI
2 participants