Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fix external containers #72

Open
wants to merge 8 commits into
base: main
Choose a base branch
from
Open

Fix external containers #72

wants to merge 8 commits into from

Commits on Jun 27, 2024

  1. fix connecting to external containers

    @ad-astra-video
    ad-astra-video committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    70b9a71 View commit details
    Browse the repository at this point in the history

  2. allow multiple external containers with same pipeline/modelID

    @ad-astra-video
    ad-astra-video committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    a4d5f37 View commit details
    Browse the repository at this point in the history

  3. send requests to ai-runner containers if none in flight

    @ad-astra-video
    ad-astra-video committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    618dc4d View commit details
    Browse the repository at this point in the history

  4. change InFlight to Capacity

    @ad-astra-video
    ad-astra-video committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    43ced58 View commit details
    Browse the repository at this point in the history

  5. fix log line and lock on borrowContainer

    @ad-astra-video
    ad-astra-video committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    0a1d1a7 View commit details
    Browse the repository at this point in the history

  6. add option to not dynamically load managed containers

    @ad-astra-video
    ad-astra-video committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    a0693ca View commit details
    Browse the repository at this point in the history

Commits on Jun 28, 2024

  1. allow multiple managed containers for same pipeline/model_id and fix … 

    …external containers capacity check
    @ad-astra-video
    ad-astra-video committed Jun 28, 2024
    Configuration menu
    Copy the full SHA
    a36337e View commit details
    Browse the repository at this point in the history

  2. add MOCK_PIPELINE env var to runner if exists

    @ad-astra-video
    ad-astra-video committed Jun 28, 2024
    Configuration menu
    Copy the full SHA
    5cbb6cc View commit details
    Browse the repository at this point in the history