Eleven labs TTS in JSON config

[shreymalua-git]

I am trying to integrate Eleven-labs in Deepgram's Voice Agent API though JSON config

Below is my JSON config:
{
"type": "Settings",
"audio": {
"input": {
"encoding": "mulaw",
"sample_rate": 8000
},
"output": {
"encoding": "mulaw",
"sample_rate": 8000,
"container": "none"
}
},
"agent": {
"language": "en",
"listen": {
"provider": {
"type": "deepgram",
"model": "nova-3"
}
},
"think": {
"provider": {
"type": "open_ai",
"model": "gpt-4o",
"temperature": 0.7
},
"prompt": ""
},
"speak": {
"provider": {
"type": "eleven_labs",
"model_id": "eleven_turbo_v2_5",
"language_code": "en-US"
},
"endpoint": {
"url": "wss://api.elevenlabs.io/v1/text-to-speech/2EiwWnXFnvU5JabPnv8n/stream-input",
"headers": {
"xi-api-key": "API_KEY"
}
}
},
"greeting": ""
}
}

Problem: Every time I am trying to send the JSON config but there is no audio output and deepgram returns this error
{"type":"Welcome","request_id":"9404e409-c7ae-44ce-afc0-953385e08492"}
{"type":"SettingsApplied"}
{"type":"Error","description":"Text message received from client did not match any of the formats we expect.","code":"UNPARSABLE_CLIENT_MESSAGE"}

Can someone please help me in integrating Eleven-Labs with deepgram?

[deepgram-community[bot]]

Thanks for asking your question. Please be sure to reply with as much detail as possible so the community can assist you efficiently.
_{Consider joining our Discord community for more opportunity to engage with your fellow Deepgram users. You can earn points which can be redeemed for cool stuff by being active in our communities!}

[deepgram-community[bot]]

Hey there! It looks like you haven't connected your GitHub account to your Deepgram account. You can do this at https://community.deepgram.com - being verified through this process will allow our team to help you in a much more streamlined fashion.

[deepgram-community[bot]]

It looks like we're missing some important information to help debug your issue. Would you mind providing us with the following details in a reply?

• The programming language you are working in (e.g. JavaScript, Python).

[shreymalua-git]

Python

[deepgram-community[bot]]

Hi there - I'm looking into your issue now and will reply back with recommended next steps. Thank you!

This message was sent by Theresa Foy from Deepgram, via our community automation.

[shreymalua-git]

Hi, just a follow up, is there any updates on the issue?

[shreymalua-git]

Is there any solution for the mentioned issue?

[deepgram-community[bot]]

Hi there - I'm still looking into the issue you got, but I noticed that we also passed through warnings from ElevenLabs below, Have you upgraded your account with them?

"Unusual activity detected. Free Tier usage disabled. If you are using a proxy/VPN you might need to purchase a Paid Plan to not trigger our abuse detectors. Free Tier only works if users do not abuse it, for example by creating multiple free accounts. If we notice that many people try to abuse it, we will need to reconsider Free Tier altogether. Please play fair and purchase any Paid Subscription to continue."

This message was sent by Theresa Foy from Deepgram, via our community automation.