Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add API to whisper_playground model service #63

Closed
MichaelClifford opened this issue Feb 28, 2024 · 3 comments
Closed

Add API to whisper_playground model service #63

MichaelClifford opened this issue Feb 28, 2024 · 3 comments
Assignees

Comments

@MichaelClifford
Copy link
Collaborator

Now that we have a whispercpp image that can be used to convert audio to text, want to use it the same way we use the existing playground image, as a model service with an exposed API. Unlike Llama_cpp_python, whisper.cpp does not appear to come with a prebuilt api server for the model. So we should create a light weight API to use for this model type.

@MichaelClifford
Copy link
Collaborator Author

It should follow the openAI API as close as possible https://platform.openai.com/docs/guides/speech-to-text

@MichaelClifford
Copy link
Collaborator Author

Alternatively, we could use the existing example server here in our current image. https://github.com/ggerganov/whisper.cpp/tree/master/examples/server

@MichaelClifford
Copy link
Collaborator Author

MichaelClifford commented Apr 2, 2024

closed by #58 and #73

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Development

No branches or pull requests

2 participants