OnnxSlim

OnnxSlim can help you slim your onnx model, with less operators, but same accuracy, better inference speed.

• 🚀 OnnxSlim is merged to mnn-llm, performance increased by 5%
• 🚀 Rank 1st in the AICAS 2024 LLM inference optimization challenge held by Arm and T-head
• 🚀 OnnxSlim is merged into ultralytics ❤️❤️❤️
• 🚀 OnnxSlim is merged into transformers.js 🤗🤗🤗
• 🚀 Achieved 1M downloads

Installation

Using Prebuilt

pip install onnxslim

Install From Source

pip install git+https://github.com/inisis/OnnxSlim@main

Install From Local

git clone https://github.com/inisis/OnnxSlim && cd OnnxSlim/
pip install .

How to use

onnxslim your_onnx_model slimmed_onnx_model

For more usage, see onnxslim -h or refer to our examples

Projects using OnnxSlim

• Mozilla/smart_autofill
• alibaba/MNN
• PaddlePaddle/PaddleOCR
• huggingface/transformers.js
• THU-MIG/yolov10
• ultralytics/ultralytics
• ModelScope/FunASR
• alibaba/MNN-LLM
• deepghs/imgutils
• sunsmarterjie/yolov12

References

• onnx-graphsurgeon
• Polygraphy
• onnx-simplifier
• tabulate
• onnxruntime

Contact

Discord: https://discord.gg/nRw2Fd3VUS QQ Group: 873569894