Popular repositories

1. deep-learning-containers deep-learning-containers Public

   Forked from aws/deep-learning-containers

   AWS Deep Learning Containers (DLCs) are a set of Docker images for training and serving models in TensorFlow, TensorFlow 2, PyTorch, and MXNet.

   Python

2. sagemaker-pytorch-inference-toolkit sagemaker-pytorch-inference-toolkit Public

   Forked from aws/sagemaker-pytorch-inference-toolkit

   Toolkit for allowing inference and serving with PyTorch on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at https://github.com/aws/deep-learning-containers.

   Python

3. serve serve Public

   Forked from pytorch/serve

   Serve, optimize and scale PyTorch models in production

   Java

4. djl-serving djl-serving Public

   Forked from deepjavalibrary/djl-serving

   A universal scalable machine learning model deployment solution

   Java

5. sagemaker-huggingface-inference-toolkit sagemaker-huggingface-inference-toolkit Public

   Forked from aws/sagemaker-huggingface-inference-toolkit

   Python

6. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python