Skip to content

run: Use the provided model reference #116

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Jul 3, 2025
Merged

Conversation

doringeman
Copy link
Collaborator

This mimics the docker run + docker ps behaviour to display the used (model) reference.

Before:

$ docker model run sha256:354bf30d0aa3af413d2aa5ae4f23c66d78980072d1e07a5b0d776e9606a2f0b9 hi
...
$ docker model ps
MODEL NAME                           BACKEND    MODE        LAST USED
index.docker.io/ai/smollm2-2:latest  llama.cpp  completion  2 seconds ago

Now:

$ docker model run sha256:354bf30d0aa3af413d2aa5ae4f23c66d78980072d1e07a5b0d776e9606a2f0b9 hi
...
$ docker model ps
MODEL NAME                                                               BACKEND    MODE        LAST USED
sha256:354bf30d0aa3af413d2aa5ae4f23c66d78980072d1e07a5b0d776e9606a2f0b9  llama.cpp  completion  2 seconds ago

Moreover, with the second commit, the previous ps output will look like this:

$ docker model ps
MODEL NAME    BACKEND    MODE        LAST USED
354bf30d0aa3  llama.cpp  completion  8 seconds ago

This mimics the docker run + docker ps behaviour to display the used (model) reference.

Signed-off-by: Dorin Geman <dorin.geman@docker.com>
Signed-off-by: Dorin Geman <dorin.geman@docker.com>
@doringeman doringeman requested a review from a team July 2, 2025 14:41
@doringeman doringeman merged commit 536a638 into docker:main Jul 3, 2025
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants