
Senior Partner Engineer @github
- GitHub Staff
- New York, NY
-
09:09
- 4h behind - https://bsky.app/profile/marzvrover.com
- @marzvrover@hachyderm.io
- marzvrover
- in/marzvrover
Stars
ml
4 repositories
A high-throughput and memory-efficient inference and serving engine for LLMs
Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 2, and other large language models.
Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚