Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use ONNX for API model serving #20

Merged
merged 35 commits into from Jun 14, 2023
Merged

Use ONNX for API model serving #20

merged 35 commits into from Jun 14, 2023

Conversation

yanirs
Copy link
Owner

@yanirs yanirs commented Jun 14, 2023

Key changes:

  • Add export_learner_to_onnx command
  • Turn fastai, torch, streamlit, and related packages into dev dependencies
  • In the API, use the ONNX model for prediction via the thin OnnxWrapper
  • Use Poetry for consistent dependencies in the Dockerfile (no more messing around to install the PyTorch CPU version 馃帀)
  • Add one-off ONNX model evaluation to 03-app.ipynb (more accurate than the fastai Learner 馃)

@yanirs yanirs merged commit 77be2ec into master Jun 14, 2023
2 checks passed
@yanirs yanirs deleted the try/onnx-export branch June 14, 2023 22:33
@yanirs yanirs mentioned this pull request Jun 14, 2023
7 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant