[Question] Onnx support in TGI

[Ben-Epstein]

Feature request

Apologies if this should be elsewhere, but I'm curious if you plan on adding support for onnx models like https://huggingface.co/microsoft/Phi-3-mini-128k-instruct-onnx

Motivation

onnx is highly optimized for throughput, which aligns well with the goals of this repo

Your contribution

I would be happy to help contribute to this if needed!

[github-actions]

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.