Skip to content
@InftyAI

InftyAI

Exploring the ∞ possibilities of AI.

Hey, this is InftyAI 🪂

InftyAI community is a non-profit organization focused on building AI infrastructure. We 💙 Open Source.

All kinds of contributions are welcomed to the community, like PRs, Issues, New Ideas, Docs, Discussions and more.

If you have made multiple contributions to the community or projects, enough to demonstrate an ongoing and long-term commitment to the community, please Open an issue against the InftyAI/community repo to join us.

Connect us via Slack, Twitter as well.

Pinned Loading

  1. Awesome-LLMOps Awesome-LLMOps Public

    🎉 An awesome & curated list of best LLMOps tools.

    28 8

  2. llmaz llmaz Public

    ☸️ Easy, advanced inference platform for large language models on Kubernetes

    Go 23 10

  3. Manta Manta Public

    💫 A lightweight P2P-based cache system for model and image distributions on Kubernetes.

    Go 6 2

  4. omnistore omnistore Public

    🎯 An unified python client to communicate with various kinds of object-store providers.

    Python 2 2

Repositories

Showing 10 of 13 repositories
  • llmaz Public

    ☸️ Easy, advanced inference platform for large language models on Kubernetes

    InftyAI/llmaz’s past year of commit activity
    Go 23 Apache-2.0 10 37 (1 issue needs help) 4 Updated Nov 4, 2024
  • Manta Public

    💫 A lightweight P2P-based cache system for model and image distributions on Kubernetes.

    InftyAI/Manta’s past year of commit activity
    Go 6 Apache-2.0 2 1 1 Updated Oct 28, 2024
  • scheduler-plugins Public

    Scheduler plugins designed for smart scheduling with llmaz.

    InftyAI/scheduler-plugins’s past year of commit activity
    Go 3 1 0 0 Updated Oct 28, 2024
  • .github Public
    InftyAI/.github’s past year of commit activity
    0 1 0 0 Updated Oct 23, 2024
  • community Public

    The InftyAI community.

    InftyAI/community’s past year of commit activity
    0 Apache-2.0 1 0 0 Updated Oct 23, 2024
  • Awesome-LLMOps Public

    🎉 An awesome & curated list of best LLMOps tools.

    InftyAI/Awesome-LLMOps’s past year of commit activity
    28 8 0 0 Updated Oct 12, 2024
  • website Public

    Website and Blogs.

    InftyAI/website’s past year of commit activity
    HTML 1 MIT 1 2 0 Updated Sep 23, 2024
  • template-repo Public

    A template repo.

    InftyAI/template-repo’s past year of commit activity
    0 Apache-2.0 1 0 0 Updated Sep 18, 2024
  • llmaz-dashboard Public

    A web console for llmaz.

    InftyAI/llmaz-dashboard’s past year of commit activity
    Python 3 Apache-2.0 5 15 0 Updated Sep 18, 2024
  • llmaz-helm Public

    Helm installation for llmaz.

    InftyAI/llmaz-helm’s past year of commit activity
    Smarty 0 1 0 0 Updated Sep 11, 2024

Top languages

Loading…

Most used topics

Loading…