Voice Agent managed Anthropic models fail with INVALID_SETTINGS: model not available #1615
Replies: 3 comments
-
|
Thanks for asking your question. Please be sure to reply with as much detail as possible so the community can assist you efficiently. |
Beta Was this translation helpful? Give feedback.
-
|
Hey there! It looks like you haven't connected your GitHub account to your Deepgram account. You can do this at https://community.deepgram.com - being verified through this process will allow our team to help you in a much more streamlined fashion. |
Beta Was this translation helpful? Give feedback.
-
|
It looks like we're missing some important information to help debug your issue. Would you mind providing us with the following details in a reply?
|
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
-
Hey Deepgram team - I’m trying to get Anthropic Haiku working through Deepgram Voice Agent, and I’m looking for help confirming the correct model ID or provisioning path.
We specifically want to use Haiku as the
agent.thinkmodel for our Voice Agent setup. OpenAI is only our temporary fallback because it is the only thing currently getting the session throughsettings-applied.What is happening
We are using the Deepgram Voice Agent SDK (
@deepgram/agents).When we configure
agent.thinkwith OpenAI, the session connects and the call works.When we configure
agent.thinkwith Anthropic Haiku, the session fails during setup with:{ "code": "INVALID_SETTINGS", "description": "Invalid agent.think settings - model not available", "type": "Error" }After that, the SDK retries with exponential backoff, but it appears to keep retrying the same rejected settings. The session never reaches
settings-applied, and no audio plays.Haiku model IDs we tried
First we tried the Haiku model ID listed in the Voice Agent LLM Models docs:
That failed with:
Then we tried the alternate Haiku 4.5 ID mentioned in the Voice Agent prompting docs:
That also failed with the same error:
So the issue does not appear to be only the
claude-4-5-haiku-latestalias.The rest of our settings object
The rest of the settings object is unchanged between the failing Haiku tests and the working OpenAI test.
Authentication is handled with a short-lived Deepgram token minted through
/v1/auth/grantwith a 60-second TTL.OpenAI works with the same setup
If we change only the
agent.think.providerblock to OpenAI, the call works normally:With OpenAI:
settings-appliedINVALID_SETTINGSerror is thrownSo from what we can tell, this likely rules out our auth flow, proxy assembly, prompt formatting, audio I/O settings, SDK setup, and network/CORS configuration.
The only meaningful change between the working and failing versions is:
Why this is confusing
The Voice Agent LLM Models docs list Anthropic as a managed provider and include
claude-4-5-haiku-latest.The Voice Agent prompting docs appear to mention that
claude-4-5-haiku-latestmay returnINVALID_SETTINGS, and suggestclaude-haiku-4-5instead.In our project, both of those Haiku IDs fail.
What we need help with
Can someone from Deepgram confirm the current correct way to use Anthropic Haiku with Voice Agent?
Specifically:
Is managed Anthropic Haiku available to all Voice Agent projects, or does it require account/project-level enablement?
Is there a support-side provisioning step, dashboard setting, account tier, or add-on required before managed Anthropic models work?
What exact model ID should we use for Anthropic Haiku 4.5 in
agent.think.provider.model?Should the correct ID be
claude-4-5-haiku-latest,claude-haiku-4-5, or something else?Does the runtime validator use the same model registry as the public docs and the
/v1/agent/settings/think/modelsendpoint?If Haiku is not available to our project yet, is
INVALID_SETTINGS: model not availablethe expected error?Current status
Our temporary fallback is:
That works, but it is not the desired end state.
The desired end state is to use managed Anthropic Haiku through Deepgram Voice Agent. We mainly need to understand whether this is:
Thanks — happy to provide any additional settings payload details if useful.
Beta Was this translation helpful? Give feedback.
All reactions