Skip to content
/ distributed-llama Public

Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.

License

MIT license
2.1k stars 148 forks Branches Tags Activity
Star
Notifications You must be signed in to change notification settings

b4rtaz/distributed-llama

Error
Looks like something went wrong!

About

Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.

Topics

neural-network distributed-computing llm llms open-llm llm-inference llama2 distributed-llm llama3

Resources

Readme

License

MIT license
Activity

Stars

2.1k stars

Watchers

40 watching

Forks

148 forks
Report repository

Releases 46

0.13.6 Latest
Apr 26, 2025
+ 45 releases

Contributors 6

Languages