Skip to content

Hey, this is InftyAI 🪂

InftyAI is a non-profit organization focused on building AI infrastructures, like LLM inference, distributed cache system, multi-agent framework etc.. We 💙 Open Source.

All kinds of contributions are welcomed to the community, like PR, Issue, Idea, Documentation and more.

If you have made multiple contributions to the community or projects, enough to demonstrate an ongoing and long-term commitment to the community, please Open an issue against the InftyAI/community repo to join us.

We also have an official fundraising venue through OpenCollective. We'll use the fund transparently to support the development, maintenance, and adoption of our community.

Link us via Discord, Slack, Twitter as well.

Pinned Loading

  1. llmaz llmaz Public

    ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!

    Go 204 31

  2. Awesome-LLMOps Awesome-LLMOps Public

    🎉 An awesome & curated list of best LLMOps tools.

    Python 120 24

  3. scheduler-plugins scheduler-plugins Public

    Scheduler-Plugins maintains a list of kubernetes scheduler plugins used in InftyAI community.

    Go 8 2

  4. community community Public

    The InftyAI community.

    1

Repositories

Showing 10 of 12 repositories
  • llmaz Public

    ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!

    InftyAI/llmaz’s past year of commit activity
    Go 204 Apache-2.0 31 37 (5 issues need help) 3 Updated Jun 19, 2025
  • karpenter Public Forked from kubernetes-sigs/karpenter

    This is a fork of Karpenter focused on GPU scaling with llmaz.

    InftyAI/karpenter’s past year of commit activity
    Go 0 Apache-2.0 290 1 0 Updated Jun 18, 2025
  • .github Public
    InftyAI/.github’s past year of commit activity
    0 Apache-2.0 1 0 0 Updated Jun 17, 2025
  • Awesome-LLMOps Public

    🎉 An awesome & curated list of best LLMOps tools.

    InftyAI/Awesome-LLMOps’s past year of commit activity
    Python 120 Apache-2.0 24 2 1 Updated Jun 17, 2025
  • scheduler-plugins Public

    Scheduler-Plugins maintains a list of kubernetes scheduler plugins used in InftyAI community.

    InftyAI/scheduler-plugins’s past year of commit activity
    Go 8 Apache-2.0 2 1 0 Updated Jun 16, 2025
  • website Public

    Website and Blogs.

    InftyAI/website’s past year of commit activity
    HTML 1 MIT 1 4 0 Updated May 14, 2025
  • community Public

    The InftyAI community.

    InftyAI/community’s past year of commit activity
    0 Apache-2.0 1 0 0 Updated Apr 18, 2025
  • template-repo Public template

    A template repo.

    InftyAI/template-repo’s past year of commit activity
    0 Apache-2.0 1 0 0 Updated Mar 15, 2025
  • Manta Public

    💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSIX promise 🎯

    InftyAI/Manta’s past year of commit activity
    Go 24 Apache-2.0 3 14 (1 issue needs help) 1 Updated Dec 6, 2024
  • omnistore Public

    🎯 An unified python client to communicate with various kinds of object-store providers.

    InftyAI/omnistore’s past year of commit activity
    Python 2 MIT 3 4 1 Updated Nov 11, 2024