-
-
Notifications
You must be signed in to change notification settings - Fork 41
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Package Request: AUR Package localai-git - Local OpenAI API replacement running on CPU,CUDA,ROCM #247
Comments
https://github.com/arch4edu/cactus/actions/runs/7054638280/job/19203830350 |
next version should work, probably with cuda too. |
(next next) 😁 |
thank you, CPU and CUDA works, ROCM currently breaks because of weird flags while compiling, but i will add it soonish, as i use ROCM hardware |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
LocalAI
The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware
currently only the cpu version builds,
i have a ROCM/AMD version already running locally (this would need the rocm builder), CUDA should be possible too
The text was updated successfully, but these errors were encountered: