Skip to content
View shixianc's full-sized avatar
😁
i like mcdonalds
😁
i like mcdonalds

Block or report shixianc

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Please don't include any personal information such as legal names or email addresses. Maximum 100 characters, markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
shixianc/README.md

Pinned Loading

  1. ray-project/ray ray-project/ray Public

    Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

    Python 33.8k 5.7k

  2. vllm-project/vllm vllm-project/vllm Public

    A high-throughput and memory-efficient inference and serving engine for LLMs

    Python 29.7k 4.5k

  3. triton-inference-server/server triton-inference-server/server Public

    The Triton Inference Server provides an optimized cloud and edge inferencing solution.

    Python 8.3k 1.5k

  4. NVIDIA/TensorRT-LLM NVIDIA/TensorRT-LLM Public

    TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

    C++ 8.6k 974

  5. triton-inference-server/model_navigator triton-inference-server/model_navigator Public

    Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.

    Python 183 25

  6. QwenLM/Qwen2-Audio QwenLM/Qwen2-Audio Public

    The official repo of Qwen2-Audio chat & pretrained large audio language model proposed by Alibaba Cloud.

    Python 1.2k 80