Skip to content
@llmariner

LLMariner

LLMariner transforms your GPU clusters into a powerhouse for generative AI workloads.
README.md

Pinned Loading

  1. llmariner Public

    Extensible generative AI platform on Kubernetes with OpenAI-compatible APIs.

    Go 68 5

Repositories

Showing 10 of 20 repositories
  • inference-manager Public

    Inference Manager

    Go 5 Apache-2.0 2 0 0 Updated Apr 30, 2025
  • model-manager Public

    Model Manager

    Go 1 Apache-2.0 0 0 0 Updated Apr 29, 2025
  • llmariner Public

    Extensible generative AI platform on Kubernetes with OpenAI-compatible APIs.

    Go 68 Apache-2.0 5 7 0 Updated Apr 28, 2025
  • llmariner.github.io Public

    GitHub Pages site

    HTML 0 Apache-2.0 1 0 1 Updated Apr 28, 2025
  • cluster-manager Public

    Cluster Manager

    Go 0 Apache-2.0 0 0 0 Updated Apr 28, 2025
  • api-usage Public

    Sub-component of LLMariner. It aggregates API usage data from other API servers.

    Go 0 Apache-2.0 0 0 0 Updated Apr 28, 2025
  • job-manager Public

    Job Manager

    Go 0 Apache-2.0 1 0 1 Updated Apr 28, 2025
  • vector-store-manager Public

    Vector Store Manager

    Go 1 Apache-2.0 0 0 0 Updated Apr 28, 2025
  • file-manager Public

    File Manager

    Go 0 Apache-2.0 0 0 0 Updated Apr 28, 2025
  • session-manager Public

    Session Manager

    Go 0 Apache-2.0 1 0 0 Updated Apr 28, 2025
View all repositories

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…