Feature Request
I would like to dynamically list models provided by a provider. This could be a new Client trait, almost all providers have /models endpoint we can call to get that list.
Motivation
When working with customer providers like LiteLLM, the list of models is not static. It depends on what the user configured.
Proposal
pub trait ListModelsClient {
/// Verify the configuration.
fn models(&self) -> impl Future<Output = Result<Vec<Model>, VerifyError>> + WasmCompatSend;
}
Feature Request
I would like to dynamically list models provided by a provider. This could be a new Client trait, almost all providers have
/modelsendpoint we can call to get that list.Motivation
When working with customer providers like LiteLLM, the list of models is not static. It depends on what the user configured.
Proposal