Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Package Request: AUR Package localai-git - Local OpenAI API replacement running on CPU,CUDA,ROCM #247

Closed
wuxxin opened this issue Nov 28, 2023 · 5 comments

Comments

@wuxxin
Copy link

wuxxin commented Nov 28, 2023

LocalAI

The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware

currently only the cpu version builds,

i have a ROCM/AMD version already running locally (this would need the rocm builder), CUDA should be possible too

petronny added a commit that referenced this issue Nov 29, 2023
@petronny
Copy link
Member

petronny commented Dec 2, 2023

==> Starting pkgver()...
==> ERROR: A failure occurred in pkgver().
    Aborting...

https://github.com/arch4edu/cactus/actions/runs/7054638280/job/19203830350

@wuxxin
Copy link
Author

wuxxin commented Dec 2, 2023

next version should work, probably with cuda too.

@wuxxin
Copy link
Author

wuxxin commented Dec 2, 2023

(next next) 😁

@petronny
Copy link
Member

petronny commented Dec 6, 2023

ba21ab7

@petronny petronny closed this as completed Dec 6, 2023
@wuxxin
Copy link
Author

wuxxin commented Dec 6, 2023

thank you, CPU and CUDA works, ROCM currently breaks because of weird flags while compiling, but i will add it soonish, as i use ROCM hardware

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants