docker-llama-cpp-python

Dockerfile for llama-cpp-python

Docker image

Pull the image from Docker Hub.

$ docker image pull dceoy/llama-cpp-python

Usage

Test the package.

$ docker container run --rm dceoy/llama-cpp-python

Test text generation.

$ docker container run \
    --rm --entrypoint /wd/chat.sh -v "${PWD}:/wd" -w /wd \
    dceoy/llama-cpp-python \
    'Q: Name the planets in the solar system?' 'A: '