A Datacenter Scale Distributed Inference Serving Framework

EasyR1: An Efficient, Scalable, Multi-Modality RL Training Framework based on veRL

FlashMLA: Efficient MLA decoding kernels

how to optimize some algorithm in cuda.

Entropy Based Sampling and Parallel CoT Decoding

documentation for content creation

Pytorch implementation of Transfusion, "Predict the Next Token and Diffuse Images with One Multi-Modal Model", from MetaAI

CUDA Templates for Linear Algebra Subroutines

A fast multimodal LLM for real-time voice

A high-throughput and memory-efficient inference and serving engine for LLMs

Manages vllm-nccl dependency

CUDA/Metal accelerated language model inference