Popular repositories

1. ray ray Public

   Forked from ray-project/ray

   An open source framework that provides a simple, universal API for building distributed applications. Ray is packaged with RLlib, a scalable reinforcement learning library, and Tune, a scalable hyp…

   Python

2. TensorRT-LLM TensorRT-LLM Public

   Forked from NVIDIA/TensorRT-LLM

   TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

   C++

3. transformers transformers Public

   Forked from huggingface/transformers

   🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

   Python

4. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with LLMs faster and more controllable.

   Python

5. llm-awq llm-awq Public

   Forked from mit-han-lab/llm-awq

   AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

   Python