Skip to content

andrewsi-z/bento-onnxmlir-model-test

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

13 Commits
 
 
 
 
 
 
 
 

Repository files navigation

bento-onnxmlir-model-test

This project demonstrates using ONNX-MLIR to compile the resnet50 model from the ONNX model zoo, and then leverages BentoML to deploy for inference.

Install ONNX-MLIR

ONNX-MLIR documentation

ONNX-MLIR project

Follow the install instructions. This will include installing prerequisites, including LLVM. Since ONNX-MLIR is a recent project as of this writing, we suggest pulling in the most recent stable version.

Alternatively, docker images are available. See the links on the ONNX-MLIR project page.

Compiling the model an running example

See resnet notebook

About

Tests to drive onnx-mlir support in bentoML

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages