Popular repositories Loading

1. AutoDeco AutoDeco Public

   Python 73 9

2. AutoMTP_vLLM AutoMTP_vLLM Public

   Adapt vLLM to AutoMTP (Early Stop for Multi-Token Prediction)

   Python 1

3. Anonymous Anonymous Public

   Theoretical analysis of ICCT 2024 submission

4. AutoDeco_vllm AutoDeco_vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs (adapted to AutoDeco heads)

   Python 1

5. hpc-ops hpc-ops Public

   Forked from Tencent/hpc-ops

   High Performance LLM Inference Operator Library

   C++