A toolkit to run Ray applications on Kubernetes

Production-Grade Container Scheduling and Management

Envoy AI Gateway is an open source project for using Envoy Gateway to handle request traffic from application clients to Generative AI services.

🦍 The Cloud-Native API Gateway and AI Gateway.

Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a toolkit of libraries (Ray AIR) for accelerating ML workloads.

Generators for kube-like API types

Kubernetes-native Job Queueing

Plugin index for https://github.com/kubernetes-sigs/krew. This repo is for plugin maintainers.

Tools to use with the controller-runtime libraries

Kubernetes website and documentation repo:

✚ Build multiple documentation folders in a single Mkdocs. Designed for large codebases.

Add-on agent to generate and expose cluster-level metrics.

Source repo for Docker's Documentation

Common generator scripts for all client libraries

Kubebuilder - SDK for building Kubernetes APIs using CRDs

Code samples used on cloud.google.com

Example for running Llama 2 on Ray with TPUs

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

node-http-proxy plus a REST API

Bazel examples

An open-source registry for VS Code extensions

TFX is an end-to-end platform for deploying production ML pipelines

Python composable command line interface toolkit

Jupyter metapackage for installation, docs and chat

Source for the istio.io site