Skip to content

Support dynamic Model Provider #3380

@growmuye

Description

@growmuye

I encountered a problem: a single LLM service provider may occasionally experience fluctuations, causing the online Agent to crash. Currently, the idea is to provide backup model service providers to ensure online stability.

I noticed that the model parameter of the SDK cannot be dynamically constructed like the instruction. I hope the ADK official can consider this matter.

Image

Other thoughts: I'm not sure yet whether parameters like top_p and temperature need to support dynamics, but if we want to ensure the effectiveness of the Prompt, the same Prompt may require different parameter configurations on different models.

Metadata

Metadata

Assignees

No one assigned

    Labels

    models[Component] Issues related to model support

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions