Docker Image for Webservice API #132
Replies: 5 comments 9 replies
-
Naive beginner question - can I run this on my Windows machine in Docker Desktop and utilize my 8gb vram nvidia GPU? Or even from Docker inside WSL2 in Windows? |
Beta Was this translation helpful? Give feedback.
-
In windows I get |
Beta Was this translation helpful? Give feedback.
-
I just get stack traces. I'm on an M1 mac. [2023-01-15 03:00:26 +0000] [7] [ERROR] Exception in ASGI application ============= |
Beta Was this translation helpful? Give feedback.
-
If someone is interested, I create a Docker image that just executes the OpenAI Whisper endpoint: |
Beta Was this translation helpful? Give feedback.
-
hi, could you please share a demo for how to send the request, including all required parameters may need. Thanks! |
Beta Was this translation helpful? Give feedback.
-
Hello,
As I already mentioned before, we created a web service (whisper-asr-webservice) api for Whisper ASR.
Now we created docker image from our webservice repository. You can pull the docker image and can test with the following command. It will be updated automatically when we push new features.
Whisper ASR Webservice now available on Docker Hub. You can find the latest version of this repository on docker hub for CPU and GPU.
Repository: https://github.com/ahmetoner/whisper-asr-webservice
Docker Hub: https://hub.docker.com/r/onerahmet/openai-whisper-asr-webservice
For CPU:
For GPU:
# Interactive Swagger API documentation is available at http://localhost:9000/docs
Available ASR_MODELs are
tiny
,base
,small
,medium
andlarge
For English-only applications, the
.en
models tend to perform better, especially for thetiny.en
andbase.en
models. We observed that the difference becomes less significant for thesmall.en
andmedium.en
models.Beta Was this translation helpful? Give feedback.
All reactions