Pinned Loading

1. hpcaitech/ColossalAI hpcaitech/ColossalAI Public

   Making large AI models cheaper, faster and more accessible

   Python 38.8k 4.3k

2. Tencent/TurboTransformers Tencent/TurboTransformers Public

   a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.

   C++ 1.5k 198

3. Tencent/PatrickStar Tencent/PatrickStar Public

   PatrickStar enables Larger, Faster, Greener Pretrained Models for NLP and democratizes AI for everyone.

   Python 747 57

4. xdit-project/xDiT xdit-project/xDiT Public

   xDiT: A Scalable Inference Engine for Diffusion Transformers (DiTs) on multi-GPU Clusters

   Python 647 51

5. LLMSpeculativeSampling LLMSpeculativeSampling Public

   Fast inference from large lauguage models via speculative decoding

   Python 553 56

6. long-context-attention long-context-attention Public

   USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference

   Python 345 21