Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bug: audio transcriptions fails with "failed to initialize the whisper context" #55

Closed
prabirshrestha opened this issue Feb 13, 2024 · 3 comments
Assignees
Labels
bug Something isn't working

Comments

@prabirshrestha
Copy link

curl http://localhost:33322/v1/audio/transcriptions   -H "Authorization: Bearer no-key-required"   -H "Content-Type: multipart/form-data"   -F file="@/Users/prabirshrestha/Downloads/frost.wav"   -F model="default"

log:

2024-02-12 23:43:51.354 Edgen[19183:19652515] WARNING: Secure coding is not enabled for restorable state! Enable secure coding by implementing NSApplicationDelegate.applicationSupportsSecureRestorableState: and returning YES.
^L2024-02-13T07:44:02.282828Z ERROR whisper_cpp::internal: ggml: whisper_model_load: tensor 'encoder.conv1.weight' has wrong shape in model file: got [80, 768, 1], expected [3, 80, 768]
2024-02-13T07:44:02.282846Z ERROR whisper_cpp::internal: ggml: whisper_init_with_params_no_state: failed to load model

config:

audio_transcriptions_models_dir: /Users/prabirshrestha/code/llm/audio_transcriptions
audio_transcriptions_model_name: ggml-distil-small.en.bin
audio_transcriptions_model_repo: distil-whisper/distil-small.en

OS: MacOS M3, Sonoma 14.2.1

@francis2tm francis2tm changed the title audio transcriptions fails with "failed to initialize the whisper context" bug: audio transcriptions fails with "failed to initialize the whisper context" Feb 26, 2024
@francis2tm francis2tm added the bug Something isn't working label Feb 26, 2024
@pedro-devv
Copy link
Contributor

We have updated whisper.cpp's version, please let me know if it still doesn't work. I can't reproduce this bug in Windows nor in Linux, and it doesn't seem to be something on our side. Unfortunately we're lacking Mac hardware, so I can't test there.

@prabirshrestha
Copy link
Author

Would be great if there is a nightly builds so I can try it easily without building from scratch.

@prabirshrestha
Copy link
Author

I have verified this works in Mac. thanks for the fix!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants