Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
19 changes: 8 additions & 11 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,23 +4,21 @@ This repository features various labs, tutorials, and other learning materials t
explore KubeFleet's capabilities and how to integrate KubeFleet with other cloud-native projects in different
use cases.

KubeFleet is a sandbox project of the [Cloud Native Computing Foundation (CNCF)](https://cncf.io/) that
helps developers manage multiple Kubernetes clusters with ease. See also the
[KubeFleet repository](https://github.com/kubefleet-dev/kubefleet) for more information.
KubeFleet is a sandbox project of the [Cloud Native Computing Foundation (CNCF)](https://cncf.io/) that helps developers manage multiple Kubernetes clusters with ease. See the [KubeFleet repository](https://github.com/kubefleet-dev/kubefleet) for more information.

## Current projects

* [Multi-cluster LLM Inference with KAITO](/multi-cluster-ai-with-kaito)

This tutorial showcases how to use KubeFleet with KAITO, a CNCF project that automates the AI/ML model inference
This tutorial showcases how to use KubeFleet with [KAITO](https://kaito-project.github.io/kaito/docs/), a CNCF project that automates the AI/ML model inference
or tuning workload in a Kubernetes cluster, to simplify multi-cluster multi-model inference tasks.

Specifically, the tutorial uses:

* KAITO, for running LLM based inference workloads in Kubernetes clusters;
* Istio, for connecting clusters in a multi-cluster service mesh;
* Kubernetes Gateway API with Inference Extension, for enabling self-hosted LLM query traffic;
* KubeFleet, for managing KAITO, Istio, and Kubernetes Gateway API resources across clusters.
* KAITO, for running LLM based inference workloads in Kubernetes clusters;
* Istio, for connecting clusters in a multi-cluster service mesh;
* Kubernetes Gateway API with Inference Extension, for enabling self-hosted LLM query traffic;
* KubeFleet, for managing KAITO, Istio, and Kubernetes Gateway API resources across clusters.

## Contributing

Expand All @@ -32,8 +30,7 @@ If you have any questions or concerns about the KubeFleet cookbook, any of its h
please raise a [GitHub issue](https://github.com/kubefleet-dev/cookbook/issues). You may also want to
[join the discussions](https://github.com/kubefleet-dev/cookbook/discussions).

---

Copyright The KubeFleet Authors. The Linux Foundation® (TLF) has registered trademarks and uses trademarks.
For a list of TLF trademarks, see [Trademark Usage](https://www.linuxfoundation.org/trademark-usage/).
=======
A collection of various demos, tutorials, and labs for using the KubeFleet project.