Popular repositories Loading

1. XPlatformer XPlatformer Public

2. tensor-fusion tensor-fusion Public

   Forked from NexusGPU/tensor-fusion

   Tensor Fusion is a state-of-the-art GPU virtualization and pooling solution designed to optimize GPU cluster utilization to its fullest potential.

   Go

3. verl verl Public

   Forked from volcengine/verl

   verl: Volcano Engine Reinforcement Learning for LLMs

   Python 1

4. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

5. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a fast serving framework for large language models and vision language models.

   Python

6. aibrix aibrix Public

   Forked from vllm-project/aibrix

   Cost-efficient and pluggable Infrastructure components for GenAI inference

   Jupyter Notebook