Skip to content

Commit

Permalink
Update README.md -GPU windows (#186)
Browse files Browse the repository at this point in the history
  • Loading branch information
ThePersonOfFun committed Jan 9, 2024
1 parent 9216486 commit a193fd5
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -344,7 +344,7 @@ binaries, and (2) you pass the `-ngl 35` flag. You also need an NVIDIA
graphics card that supports CUDA. There's no support yet for AMD GPUs.
You can also use CUDA via WSL by enabling [Nvidia CUDA on WSL](https://learn.microsoft.com/en-us/windows/ai/directml/gpu-cuda-in-wsl)
and running your llamafiles inside of WSL. This will also allow you to use
llamafiles greater than 4GB on Windows.
llamafiles greater than 4GB on Windows. NOTE: If you have two different GPUs(integrated AMD, and dedicated NVIDIA like a laptop) then you need to add -ngl 35 --gpu NVIDIA

On Linux, Nvidia cuBLAS GPU support will be compiled on the fly if (1)
you have the `cc` compiler installed, (2) you pass the `-ngl 35` flag to
Expand Down

0 comments on commit a193fd5

Please sign in to comment.