Runpod Installation Scripts

Qwen2.5-72B-Instruct-Q4_K_M running with llama.cpp

curl -fsSL https://raw.githubusercontent.com/sulla-ai/runpod-installation-scripts/main/install-llama-cpp-Qwen2.5-72B-Instruct-Q4_K_M.sh | bash

Qwen2.5-72B-Instruct-Q6_K running with llama.cpp

curl -fsSL https://raw.githubusercontent.com/sulla-ai/runpod-installation-scripts/main/install-llama-cpp-Qwen2.5-72B-Instruct-Q6_K.sh | bash

Qwen3.5-27B-UD-Q4_K_XL.gguf.sh

curl -fsSL https://raw.githubusercontent.com/sulla-ai/runpod-installation-scripts/main/Qwen3.5-27B-UD-Q4_K_XL.gguf.sh | bash

Qwen3.5-35B-A3B running with llama.cpp

curl -fsSL https://raw.githubusercontent.com/sulla-ai/runpod-installation-scripts/main/install-llama-cpp-Qwen3.5-35B-A3B.sh | bash

After launch:

tail -f /tmp/vllm.log
curl http://127.0.0.1:8000/v1/models

Name		Name	Last commit message	Last commit date
Latest commit History 23 Commits
Qwen3.5-27B-UD-Q4_K_XL.gguf.sh		Qwen3.5-27B-UD-Q4_K_XL.gguf.sh
README.md		README.md
install-llama-cpp-Qwen2.5-72B-Instruct-Q4_K_M.sh		install-llama-cpp-Qwen2.5-72B-Instruct-Q4_K_M.sh
install-llama-cpp-Qwen2.5-72B-Instruct-Q6_K.sh		install-llama-cpp-Qwen2.5-72B-Instruct-Q6_K.sh
install-llama-cpp-Qwen3.5-27B-UD-Q4_K_XL.gguf		install-llama-cpp-Qwen3.5-27B-UD-Q4_K_XL.gguf
install-llama-cpp-Qwen3.5-35B-A3B.sh		install-llama-cpp-Qwen3.5-35B-A3B.sh

Provide feedback