Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Convert input types based on MLflow's model signature #162

Closed
adriangonz opened this issue Apr 12, 2021 — with Board Genius Sync · 0 comments · Fixed by #285
Closed

Convert input types based on MLflow's model signature #162

adriangonz opened this issue Apr 12, 2021 — with Board Genius Sync · 0 comments · Fixed by #285

Comments

Copy link
Contributor

MLflow models provide a typing mechanism through their model signatures. These types are used to validate the input payloads, therefore is important that the mlserver-mlflow runtime takes them into account when converting from the V2 Protocol to an MLflow-valid input (see #160 and #161).

There is currently a mismatch between the types supported by the V2 Dataplane and MLflow native types. For example,

  • MLflow allows you to set an input column as a string, whereas BYTES is the closest type in the V2 Dataplane.
  • MLflow allows you to set an input column as binary, which is expected to be a base64 string. This is different to the BYTES field in the V2 Dataplane (which doesn't specify explicitly how these field needs to be transmitted).

This conversion will also need to take into account how to convert between the V2 "lower-level" types and MLflow's native types.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
No open projects
Development

Successfully merging a pull request may close this issue.

2 participants