Request for CUDA 12.5 Prebuilts

[gformcreation]

I would be really grateful if we can have prebuilts for cuda 12.5.
Thanks

[dirkpetersen]

This is really quite fast and easy when using pixi, just pick the python and cuda version you need.

https://github.com/dirkpetersen/dptests/tree/main/llm/llama-cpp-server

curl -fsSL https://pixi.sh/install.sh | bash

cd /my/conda/environments
pixi init llama-cpp
cd llama-cpp
pixi add python=3.9 pip ipython gcc=13 gxx=13 cuda=12.5
pixi add --pypi openai
pixi shell

CMAKE_ARGS="-DGGML_CUDA=on" pip install --upgrade llama-cpp-python[server]