Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

talk-llama: optional wake-up command and audio confirmation #1765

Merged
merged 5 commits into from Jan 16, 2024

Conversation

Rakksor
Copy link
Contributor

@Rakksor Rakksor commented Jan 14, 2024

This adds two optional flags to talk-llama:

  • -w TEXT / --wake-command TEXT: only process commands starting with the given text. This is basically a 1:1 copy of the always-prompt mode code from the command example.
  • -ho TEXT / --heard-ok TEXT: A word or phrase said by the TTS to confirm that the text is being processed. This plays directly after whisper transcription to bridge the silence until llama generated an answer (useful for slower systems).

Example usage:

./talk-llama -mw ./models/ggml-tiny.en.bin \
             -ml ../llama.cpp/models/tinyllama-1.1b-chat-v1.0.Q4_K_M.gguf \
             -w "computer" \
             -ho "processing"

This will only answer to input starting with "computer" and say "processing" while waiting for an answer.

@Rakksor Rakksor changed the title talk-llama: wake-up command and audio confirmation talk-llama: optional wake-up command and audio confirmation Jan 14, 2024
@ggerganov ggerganov merged commit f661415 into ggerganov:master Jan 16, 2024
39 checks passed
jiahansu pushed a commit to OOPRY/whisper.cpp that referenced this pull request Apr 17, 2024
…ov#1765)

* talk-llama: add optional wake-word detection from command

* talk-llama: add optional audio confirmation before generating answer

* talk-llama: fix small formatting issue in output

* talk-llama.cpp: fix Windows build
viktor-silakov pushed a commit to viktor-silakov/whisper_node_mic.cpp that referenced this pull request May 11, 2024
…ov#1765)

* talk-llama: add optional wake-word detection from command

* talk-llama: add optional audio confirmation before generating answer

* talk-llama: fix small formatting issue in output

* talk-llama.cpp: fix Windows build
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants