Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

enhancement: external stt #2248

Closed
Stargate256 opened this issue May 14, 2024 · 3 comments
Closed

enhancement: external stt #2248

Stargate256 opened this issue May 14, 2024 · 3 comments
Assignees
Milestone

Comments

@Stargate256
Copy link

Is your feature request related to a problem? Please describe.
Would it be possible to allow running whisper on another server?

Describe the solution you'd like
Adding the ability to connect to whisper via some kind of API.

Additional context
I am running open-webui on a server without GPUs, and LLMs, TTS on another server.

@tjbck tjbck changed the title remote whisper enhancement: external stt May 14, 2024
@fedirz
Copy link

fedirz commented May 27, 2024

I've recently developed faster-whisper-server which provides an OpenAI compatible transcription/translation (and some extras as well) which could be used as a transcription backend if OpenWebUI adds support for having an external STT

@tjbck tjbck self-assigned this Jun 7, 2024
@tjbck tjbck added this to the v0.3.0 milestone Jun 7, 2024
@tjbck
Copy link
Contributor

tjbck commented Jun 8, 2024

@colaber2

STT & TTS settings have been refactored on dev and you can now configure external OpenAI STT from Admin Settings!

image

image

@tjbck tjbck closed this as completed Jun 8, 2024
@bannert1337
Copy link
Contributor

I tried this and the model name for STT is not correctly used.
Screenshot 2024-06-08 at 16-30-36 Admin Panel Open WebUI

ValueError: Invalid model size 'whisper-1', expected one of: tiny.en, tiny, base.en, base, small.en, small, medium.en, medium, large-v1, large-v2, large-v3, large, distil-large-v2, distil-medium.en, distil-small.en, distil-large-v3

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants