Pinned Loading

1. vectorch-ai/ScaleLLM vectorch-ai/ScaleLLM Public

   A high-performance inference system for large language models, designed for production environments.

   C++ 329 24

2. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 22.9k 3.2k

3. cuda_hgemm_study cuda_hgemm_study Public

   Forked from Bruce-Lee-LY/cuda_hgemm

   The repository is to study the CUDA tensor core forked from Bruce-Lee-LY. Thanks to Bruce-Lee-LY!

   Cuda 1

4. flashinfer flashinfer Public

   Forked from flashinfer-ai/flashinfer

   The repository is for learning the FlashInfer and add some notes

   Cuda

5. flash-attention flash-attention Public

   Forked from Dao-AILab/flash-attention

   The reposity is to learn the cutlass by the flash-attention demo

   Python

6. LoRA LoRA Public

   Forked from microsoft/LoRA

   Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

   Python