Popular repositories

1. Leetcode Leetcode Public

   leetcode解题记录

2. FlagPerf FlagPerf Public

   Forked from FlagOpen/FlagPerf

   FlagPerf is an open-source software platform for benchmarking AI chips.

   Python

3. DeepSeek-LLM DeepSeek-LLM Public

   Forked from deepseek-ai/DeepSeek-LLM

   DeepSeek LLM: Let there be answers

   Makefile

4. TensorRT-LLM TensorRT-LLM Public

   Forked from NVIDIA/TensorRT-LLM

   TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

   C++

5. Awesome-LLM-Inference Awesome-LLM-Inference Public

   Forked from DefTruth/Awesome-LLM-Inference

   📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.

6. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python