-
Notifications
You must be signed in to change notification settings - Fork 2.5k
Open
Labels
models[Component] Issues related to model support[Component] Issues related to model support
Description
I encountered a problem: a single LLM service provider may occasionally experience fluctuations, causing the online Agent to crash. Currently, the idea is to provide backup model service providers to ensure online stability.
I noticed that the model parameter of the SDK cannot be dynamically constructed like the instruction. I hope the ADK official can consider this matter.
Other thoughts: I'm not sure yet whether parameters like top_p and temperature need to support dynamics, but if we want to ensure the effectiveness of the Prompt, the same Prompt may require different parameter configurations on different models.
trofoto
Metadata
Metadata
Assignees
Labels
models[Component] Issues related to model support[Component] Issues related to model support