|
On Windows I downloaded the llama portable variant and it only has llama.cpp backend. How do I install other backends? I notably want Transformers I think as I want to run Qwen 3.6 27b and Gemma 4 31b BF16 on an RTX Pro 6K WS. |
Answered by
Slion
Jun 7, 2026
Replies: 2 comments 1 reply
|
Looks like the portable build is not what I want here are the full install instructions: |
0 replies
Answer selected by
Slion
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Looks like the portable build is not what I want here are the full install instructions:
https://github.com/oobabooga/textgen#full-installation