Skip to content
@InftyAI

InftyAI

Exploring the ∞ possibilities of AI.
README.md

Hey, this is InftyAI 🪂

InftyAI is a non-profit organization focused on building AI infrastructure. We 💙 Open Source.

All kinds of contributions are welcomed to the community, like PR, Issue, Idea, Documentation and more.

If you have made multiple contributions to the community or projects, enough to demonstrate an ongoing and long-term commitment to the community, please Open an issue against the InftyAI/community repo to join us.

We also have an official fundraising venue through OpenCollective. We'll use the fund transparently to support the development, maintenance, and adoption of our community.

Link us via Slack, Twitter as well.

Pinned Loading

  1. Awesome-LLMOps Awesome-LLMOps Public

    🎉 An awesome & curated list of best LLMOps tools.

    41 10

  2. llmaz llmaz Public

    ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!

    Go 80 13

Repositories

Showing 10 of 13 repositories
  • llmaz Public

    ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!

    InftyAI/llmaz’s past year of commit activity
    Go 80 Apache-2.0 13 36 (5 issues need help) 0 Updated Feb 27, 2025
  • PUMA Public

    Aim to be a lightweight, high-performance inference engine for heterogeneous devices. WIP.

    InftyAI/PUMA’s past year of commit activity
    Rust 0 Apache-2.0 1 4 0 Updated Feb 25, 2025
  • scheduler-plugins Public

    Scheduler plugins designed for smart scheduling with llmaz.

    InftyAI/scheduler-plugins’s past year of commit activity
    Go 3 Apache-2.0 1 0 0 Updated Feb 24, 2025
  • .github Public
    InftyAI/.github’s past year of commit activity
    0 Apache-2.0 1 0 0 Updated Feb 15, 2025
  • Awesome-LLMOps Public

    🎉 An awesome & curated list of best LLMOps tools.

    InftyAI/Awesome-LLMOps’s past year of commit activity
    41 Apache-2.0 10 0 0 Updated Feb 13, 2025
  • llmchat Public

    ChatUI for LLMs on llmaz.

    InftyAI/llmchat’s past year of commit activity
    Python 3 Apache-2.0 5 1 0 Updated Feb 8, 2025
  • website Public

    Website and Blogs.

    InftyAI/website’s past year of commit activity
    HTML 1 MIT 1 2 0 Updated Feb 5, 2025
  • Manta Public

    💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSIX promise 🎯

    InftyAI/Manta’s past year of commit activity
    Go 20 Apache-2.0 2 14 (1 issue needs help) 1 Updated Dec 6, 2024
  • omnistore Public

    🎯 An unified python client to communicate with various kinds of object-store providers.

    InftyAI/omnistore’s past year of commit activity
    Python 2 MIT 2 3 0 Updated Nov 11, 2024
  • community Public

    The InftyAI community.

    InftyAI/community’s past year of commit activity
    0 Apache-2.0 1 0 0 Updated Oct 23, 2024
View all repositories

Top languages

Loading…

Most used topics

Loading…