Focus on prompting and generating

LLM inference in C/C++

Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 2, and other large language models.

LLM plugin for running models using MLC

Bring portraits to life!