Documentation on how to use ONNX models

[Leftyx]

Feature request type

sample request

Is your feature request related to a problem? Please describe

In the documentation there is always a reference to the Mkldnn usage but, apparently, the device also support ONNX.
I don't seem to be able to find any sample code or explanation on how to use it.
I've fiddled with the code replacing the device but it does not work.

Describe the solution you'd like

Some sample code and some documentation for the ONNX integration.

Describe alternatives you've considered

RapidOCR (c# integration) which provides a solution for ONNX models.

Additional context

No response

[sdcb]

you can refer to: https://github.com/sdcb/PaddleSharp?tab=readme-ov-file#paddle-devices

[Leftyx]

you can refer to: https://github.com/sdcb/PaddleSharp?tab=readme-ov-file#paddle-devices

It does not help at all. Where should I put the ONNX models ? What bits and pieces of code should I change ?
A super-short example would be enough to guide us through.

Thanks

[sdcb]

No it does not supports read ONNX model, it supports read paddle model and convert into ONNX and then inference.

[Leftyx]

I don't quite understand.
I would expect the process to convert the models in ONNX and use those (ONNX) models.

[sdcb]

when you specify PaddleDevice.Onnx(), it will convert paddle model into ONNX model in memory, and then inference the ONNX model in memory.

[Leftyx]

I assume that would slow down the process quite a lot. Se there is no added value in using ONNX I can immagine.
And also it would mean I cannot use a local model !? The servers where the inference happens are offline.
Thanks for the explanation.

[sdcb]

It should be quite fast because I noticed in most of scenarios the speed is quite fast even compares to mkldnn

[Leftyx]

Correct me I am wrong. I would have to use the online models. Am I right ?
Anyway, product is very well engineered. Great job 😄

[n0099]

And also it would mean I cannot use a local model !?

#105 #104 #84 #80 #62 #32

@sdcb May you pin some of these issues?

[sdcb]

Oh thank you @n0099 I missed these part, yeah sure @Leftyx you can use local models, try with FromDirectory method or use the Local package.