Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
-
Updated
Mar 23, 2025 - C++
Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
Add a description, image, and links to the distributed-llm topic page so that developers can more easily learn about it.
To associate your repository with the distributed-llm topic, visit your repo's landing page and select "manage topics."