Popular repositories Loading

1. llama.cpp llama.cpp Public

   Forked from ggerganov/llama.cpp

   Port of Facebook's LLaMA model in C/C++

   C++

2. lmdeploy lmdeploy Public

   Forked from InternLM/lmdeploy

   LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

   C++

3. TensorRT-LLM TensorRT-LLM Public

   Forked from NVIDIA/TensorRT-LLM

   TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

   C++

4. llvm-project llvm-project Public

   Forked from llvm/llvm-project

   The LLVM Project is a collection of modular and reusable compiler and toolchain technologies.