☸️ Easy, advanced inference platform for large language models on Kubernetes

Koordinator Helm Charts.

A QoS-based scheduling system brings optimal layout and status to workloads such as microservices, web services, big data jobs, AI jobs, etc.

Production-Grade Container Scheduling and Management

Ollama负载均衡服务器 | 一款高性能、易配置的开源负载均衡服务器，优化Ollama负载。它能够帮助您提高应用程序的可用性和响应速度，同时确保系统资源的有效利用。

wy876 POC

Cost-efficient and pluggable Infrastructure components for GenAI inference

Get up and running with Llama 3, Mistral, Gemma, and other large language models.

Helm chart for Ollama on Kubernetes

🦜🔗 Build context-aware reasoning applications

Descheduler for Kubernetes

Repository for out-of-tree scheduler plugins based on scheduler framework.

NVIDIA device plugin for Kubernetes

Example DRA driver that developers can fork and modify to get them started writing their own.

Prometheus-based Kubernetes Resource Recommendations

NVIDIA GPU Operator creates, configures, and manages GPUs in Kubernetes

A high-throughput and memory-efficient inference and serving engine for LLMs

Awesome-LLM: a curated list of Large Language Model

Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! 🐫

🏠 将小爱音箱接入 ChatGPT 和豆包，改造成你的专属语音助手。

使用Ansible脚本安装K8S集群，介绍组件交互原理，方便直接，不受国内网络环境影响

Prometheus ephemeral storage metrics exporter

The simulator for the Kubernetes scheduler

This is a place for various problem detectors running on the Kubernetes nodes.

Operator for managing Node Feature Discovery deployment

A Chaos Engineering Platform for Kubernetes.

A collection of useful Go libraries to ease the development of NVIDIA Operators for GPU/NIC management.

Dynamic Resource Allocation (DRA) for NVIDIA GPUs in Kubernetes