Skip to content

llama-cpp-python 0.3.8 (CUDA 12.8, Gemma 3 Support) — Windows x64 Prebuilt Wheel

Choose a tag to compare

View all tags
@boneylizard boneylizard released this 27 Apr 06:37
· 3 commits to main since this release
0.3.8+cu128.gemma3
1073f58
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Summary

This release provides a prebuilt .whl for llama-cpp-python version 0.3.8, compiled for Windows 10/11 (x64) with CUDA 12.8 acceleration enabled.

It includes full Gemma 3 model support (1B, 4B, 12B, 27B) and is based on llama.cpp release b5192 (April 26, 2025).

Highlights

  • Prebuilt for Windows x64: ready to install using pip.
  • Built against CUDA 12.8 for full GPU acceleration.
  • Verified multi-GPU offloading with Google's Gemma 3 open-weight models.
  • No manual Visual Studio or CMake compilation required.
  • Optimized for high-performance local LLM inference.

Installation

Download the .whl file below.

In a Python 3.11 virtual environment (recommended):

pip install llama_cpp_python-0.3.8+cu128.gemma3-cp311-cp311-win_amd64.whl

System Requirements:

Windows 10 or 11 (64-bit)

NVIDIA GPU with CUDA 12.8 compatible drivers

Python 3.8+ (tested on 3.11)

Acknowledgments:

Built by Bernard Peter Fitzgerald (@boneylizard). Based on abetlen/llama-cpp-python and ggml-org/llama.cpp.

License: MIT

Contributors

boneylizard
Assets 3
Loading