Repository navigation
OpenValet: sherpa-onnx KWS + Parakeet in an open-source macOS voice agent #4191
SamarthY06
started this conversation in
Show and tell
Replies: 1 comment 1 reply
|
A truncated archive that still comes back 200 gets past a fallback that only watches for timeouts and HTTP errors. The sherpa-onnx release tags publish a checksum.txt with a SHA-256 for every archive, so you can verify before extracting and treat a mismatch, a failed extraction or a missing tokens.txt as one more reason to try the next mirror. |
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
OpenValet is an open-source (MIT) voice and WhatsApp agent for macOS. You say "Hey Mac" and Claude, on the user's own Claude login, does the work across apps such as Chrome, Mail, WhatsApp, Notes and Calendar; a safety gate asks before anything irreversible. The whole speech side runs locally on the Mac, and sherpa-onnx carries two of the three pieces:
sherpa-onnx-kws-zipformer-gigaspeech-3.3Mwith the keywords "hey mac" and "ok mac". The phrase follows whatever the user names the assistant, so "hey jarvis" works too. With the keyword spotter listening, the app idles at about 1% CPU.sherpa-onnx-nemo-parakeet-tdt-0.6b-v2-int8throughOfflineRecognizer, run on each utterance after Silero VAD segments it. Pipecat Smart Turn v3.2 decides from the audio whether the sentence is finished.One practical note from the installer: it downloads each model from the sherpa-onnx GitHub release first and falls through to the HuggingFace mirrors of the same archives on a timeout or HTTP error. Those mirrors have saved installs when GitHub's download CDN was slow, so thank you for publishing both.
Thanks to the k2-fsa team for the models, the KWS recipe and the Python package; the local speech stack was straightforward to wire up because of them.
Repo: https://github.com/SamarthY06/OpenValet
All reactions