Skip to content

Add support for concurrency in AsyncAPI #2100

Closed
@miguelvr

Description

@miguelvr

Description

Add multi-processing and multi-threading support for AsyncAPI

Motivation

This would allow users to share resources and increase API throughput. This is especially relevant when using GPUs since each replica can only request a whole GPU at a time.

Metadata

Metadata

Assignees

No one assigned

    Labels

    AsyncAPISomething related to the AsyncAPI kindenhancementNew feature or requesttimecappedAssigned a limited amount of time

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions