Ability to pull/push models from/to OCI registries

[raffaelespazzoli]

if we wish ollama to be adopted in traditional enterprises, it should be possible to pull/push models from/to private model registries.
I am not sure if there is a standard for model registries, but the OCI container registry spec[1] can be adapted to manage any type of content and OCI registries are readily available in enterprises.
It seems to make sense then to enhance ollama to be able to pull and push from/to OCI registries.
I'd like to know what the feedback from the community is on this idea. If positive, I'd be happy to try to contribute this feature.

[1] OCI distribution specification to be precise: https://github.com/opencontainers/distribution-spec

[mofanke]

It will work for private OCI container registry, I've tried it, and it does work.

[raffaelespazzoli]

how do you do pull from a registry? I didn't find the option.

[pdevine]

You can use Ollama with an OCI registry right now as long as you don't need auth.

To pull from a different registry you can use: ollama pull <host>/<namespace>/<repo>:<tag>

I'm going to go ahead and close the issue, but feel free to keep commenting.

[raffaelespazzoli]

ok, wonderful. I didn't find that in the docs. Should we work on supporting authenticated repos?