Using OpenVINO Models?

[bpoulliot]

I'm brand new to setting up my own AI to play with, running an Arc A380 (meaning I'm on the very small end of the model spectrum). I looked into OpenVINO probably a year or two ago and was flustered with the expected level of expertise from the get-go. LocalAI (and LocalAGI, which I'm diving into after I refine my models) has lowered that bar significantly, however, I'm still at a loss.

I installed several of the OpenVINO models from the gallery and yet I can't use them for the intended initial task -- chat. They all show up as transformers and I'm lost on how to configure things properly to use the OpenVINO models. There are also a TON more on Huggingface (https://huggingface.co/OpenVINO) though they may not be optimized for LocalAI.

So my questions:

1. How do I utilize the OV models that exist in the model gallery?
2. Am I able to add any of the OV models from HF into LocalAI to try them out? Specifically interested in the image gen, but there are some DeepSeek distills that might be interesting to play with as well.

Is there general help for this anywhere? I tried creating YAML definitions and just got errors, which is 100% on my end, as I don't understand the information needed or available without a spec + options. Thanks for any help you can provide!