GPUStack

All

9 repositories

gpustack
Public
Manage GPU clusters for running AI models
metal cuda inference distributed openai llama maas rocm ascend llm
Python
•
Apache License 2.0
•264•2.7k•359•13•Updated May 9, 2025May 9, 2025
gpustack-ui
Public
TypeScript
•
Apache License 2.0
•22•33•2•0•Updated May 9, 2025May 9, 2025
llama-box
Public
LM inference server implementation based on *.cpp.
cpp transformer diffusion gguf openai-compatible-api
C++
•
MIT License
•16•186•3•0•Updated May 9, 2025May 9, 2025
gguf-parser-go
Public
Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
go llama-cpp gguf stable-diffusion-cpp llama-box
Go
•
MIT License
•16•159•1•0•Updated May 9, 2025May 9, 2025
.github
Public
Meta-Github repository for all GPUStack repositories.
github-metadata
Dockerfile
•
Apache License 2.0
•0•0•0•0•Updated Apr 30, 2025Apr 30, 2025
gpustack.github.io
Public
HTML
•1•0•0•0•Updated Apr 27, 2025Apr 27, 2025
vox-box
Public
A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.
python text-to-speech tts speech-to-text stt audio-processing asr openai-compatible-api
Python
•
Apache License 2.0
•12•110•10•0•Updated Apr 15, 2025Apr 15, 2025
fastfetch
Public
Like neofetch, but much faster because written mostly in C.
C
•
MIT License
•499•0•0•0•Updated Oct 24, 2024Oct 24, 2024
gguf-packer-go
Public
Deliver LLMs of GGUF format via Dockerfile.
go llama gguf
Go
•
MIT License
•3•12•0•0•Updated Oct 24, 2024Oct 24, 2024