Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature]: Support Azure OpenAI in Text-To-Speech #4002

Closed
lurebat opened this issue Jun 4, 2024 · 5 comments · Fixed by #4449
Closed

[Feature]: Support Azure OpenAI in Text-To-Speech #4002

lurebat opened this issue Jun 4, 2024 · 5 comments · Fixed by #4449
Labels
enhancement New feature or request

Comments

@lurebat
Copy link

lurebat commented Jun 4, 2024

The Feature

Great work on #3928 , but currently it only supports openai and compatible endpoints, and not azure's API.

Motivation, pitch

I use litellm's proxy to use azure's openapi with plenty of compatible software, but currently there is no workaround for text-to-speech.

The api is very similar obviously, it just needs the minor adjusments all azure apis have

Twitter / LinkedIn details

No response

@lurebat lurebat added the enhancement New feature or request label Jun 4, 2024
@krrishdholakia
Copy link
Contributor

hey @lurebat curious how do you plan on using litellm proxy w/ azure tts?

if there's a specific software / e2e flow you had in mind, that would help me test it out

also is this the azure tts - https://learn.microsoft.com/en-us/azure/ai-services/speech-service/rest-text-to-speech?tabs=streaming#request-body-1?

it seems to require some sort of separate query language (SSML)

@lurebat
Copy link
Author

lurebat commented Jun 6, 2024

Hey, I want to use it with https://github.com/danny-avila/LibreChat and homeassistant.

What you linked is another service and not what I'm referring to, I want to use the openai speech api: https://learn.microsoft.com/en-us/azure/ai-services/openai/text-to-speech-quickstart?tabs=command-line#rest-api

@krrishdholakia
Copy link
Contributor

Got it, thanks for clarifying

@Manouchehri
Copy link
Collaborator

Likewise, I want to use tts-1-hd on Azure OpenAI through LiteLLM for LibreChat.

https://www.librechat.ai/docs/configuration/stt_tts#openai-compatible-tts-services

@krrishdholakia
Copy link
Contributor

Hi @lurebat PR for this is now live - #4449


Can we do a 10min call this week? Would love to learn how you're using litellm, so we can improve

https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants