Skip to content

feat: List models #1075

@Sytten

Description

@Sytten
  • I have looked for existing issues (including closed) about this

Feature Request

I would like to dynamically list models provided by a provider. This could be a new Client trait, almost all providers have /models endpoint we can call to get that list.

Motivation

When working with customer providers like LiteLLM, the list of models is not static. It depends on what the user configured.

Proposal

pub trait ListModelsClient {
    /// Verify the configuration.
    fn models(&self) -> impl Future<Output = Result<Vec<Model>, VerifyError>> + WasmCompatSend;
}

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions