Run 70B+ LLMs on a single 4GB GPU — no quantization required.
-
Updated
Feb 28, 2026 - Python
#
airllm
Here is 1 public repository matching this topic...
Improve this page
Add a description, image, and links to the airllm topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the airllm topic, visit your repo's landing page and select "manage topics."