Serving open source models of your choice in as a docker container using llama-cpp-python's OpenAI compatible server
-
Updated
Apr 7, 2024 - Dockerfile
Serving open source models of your choice in as a docker container using llama-cpp-python's OpenAI compatible server
Add a description, image, and links to the llama-cpp-python topic page so that developers can more easily learn about it.
To associate your repository with the llama-cpp-python topic, visit your repo's landing page and select "manage topics."