Pinned Loading

1. mlc-llm mlc-llm Public

   Universal LLM Deployment Engine with ML Compilation

   Python 20.7k 1.7k

2. web-llm web-llm Public

   High-performance In-browser LLM Inference Engine

   TypeScript 15.6k 1k

3. mlc-zh mlc-zh Public

   Python 607 66

4. mlc-en mlc-en Public

   Python 415 47

5. web-llm-chat web-llm-chat Public

   Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.

   TypeScript 755 129

6. xgrammar xgrammar Public

   Fast, Flexible and Portable Structured Generation

   C++ 990 70