sha256:841b199aed2649a748875b043b32fed2e8c2d4d87e1d563556817fb7fa44b72b
Install from the command line
$ docker pull ghcr.io/ggml-org/llama.cpp@sha256:841b199aed2649a748875b043b32fed2e8c2d4d87e1d563556817fb7fa44b72b
Use as base image in Dockerfile:
FROM ghcr.io/ggml-org/llama.cpp@sha256:841b199aed2649a748875b043b32fed2e8c2d4d87e1d563556817fb7fa44b72b
linux/amd64
$ docker pull ghcr.io/ggml-org/llama.cpp:server-cuda12-b9603@sha256:b74981198242837ddcefb236e0ef20c014b4d0f3b4c079d435380c45098a99fa
linux/arm64
$ docker pull ghcr.io/ggml-org/llama.cpp:server-cuda12-b9603@sha256:ea208e926ba3b4a6865d5ec500224cdd952a144ef4809e2005ce94b0bff36331
LLM inference in C/C++
Details
- llama.cpp
-
ggml-org
- ggml-org/llama.cpp
- 2 months ago
Download activity
- Total downloads 75,221
- Last 30 days 349
- Last week 70
- Today 17