Skip to content

feat(stt): add base_url and language support for local whisper servers#616

Merged
bug-ops merged 1 commit intomainfrom
feat/stt-local-whisper-server
Feb 19, 2026
Merged

feat(stt): add base_url and language support for local whisper servers#616
bug-ops merged 1 commit intomainfrom
feat/stt-local-whisper-server

Conversation

@bug-ops
Copy link
Copy Markdown
Owner

@bug-ops bug-ops commented Feb 19, 2026

Summary

  • Add base_url and language fields to [llm.stt] config, enabling OpenAI-compatible local whisper servers (e.g. whisper.cpp) without requiring an OpenAI API key
  • Pass language parameter in Whisper API transcription requests for accurate non-English speech recognition
  • Preserve voice message attachments through drain_channel buffering so audio arriving during warmup is not lost
  • Add configurable language support for the candle-whisper backend
  • Document whisper.cpp server setup with Metal acceleration on macOS

Test plan

  • cargo +nightly fmt --check passes
  • cargo clippy --workspace -- -D warnings passes
  • cargo nextest run --workspace --lib --bins passes (2011 tests)
  • Manual test: Telegram voice message -> whisper.cpp server -> transcribed text -> agent response
  • Verified language parameter produces correct non-English transcription

Add base_url and language fields to SttConfig, allowing the Whisper STT
provider to target OpenAI-compatible local servers (e.g. whisper.cpp)
without requiring an OpenAI API key. Pass language parameter in
transcription requests for accurate non-English speech recognition.

Preserve voice message attachments through drain_channel buffering and
add configurable language support for the candle-whisper backend.
@github-actions github-actions bot added enhancement New feature or request size/L Large PR (201-500 lines) documentation Improvements or additions to documentation llm zeph-llm crate (Ollama, Claude) rust Rust code changes core zeph-core crate and removed enhancement New feature or request size/L Large PR (201-500 lines) labels Feb 19, 2026
@bug-ops bug-ops enabled auto-merge (squash) February 19, 2026 21:16
@bug-ops bug-ops merged commit 0ba52ce into main Feb 19, 2026
22 checks passed
@bug-ops bug-ops deleted the feat/stt-local-whisper-server branch February 19, 2026 21:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

core zeph-core crate documentation Improvements or additions to documentation llm zeph-llm crate (Ollama, Claude) rust Rust code changes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant