Repository navigation
Speakers
github-actions[bot] edited this page Nov 21, 2026
·
3 revisions
Speaker labels (diarization, #52): [transcribe] diarize = true adds pyannote's speaker
turns to the same Modal call (or the local WhisperX run), so words.jsonl says who is talking.
The model is gated on Hugging Face:
- On huggingface.co, sign in and accept the terms on
pyannote/speaker-diarization-community-1. Then Settings → Access Tokens → a Read token. - Store it as a Modal secret (never in clipper.toml):
.venv/Scripts/python.exe -m modal secret create huggingface HF_TOKEN=hf_.... Forbackend = "whisperx"setHF_TOKENas a user environment variable instead. -
clippa transcribe --deploy: the image now bakes the diarization model with that token, so the deploy fails until the secret exists. - Turn it on per show, e.g.
[shows.kino.transcribe] diarize = true(or one stream'sstreams/<id>/config.toml).clippa doctor --role gpuchecks the secret. - Name the regulars once:
clippa speakers <stream>lists SPEAKER_00, SPEAKER_01... with their talk time and longest lines;clippa speakers <stream> --name SPEAKER_01=Andy --name SPEAKER_00=PPP --enrollnames them and keeps their voices in[paths] voices(voices/<show>.json). Later streams of that show are named by voice ([speakers] match). A stream transcribed before:clippa speakers <stream> --diarize(diarization alone). Enroll only someone's normal voice: name an impression or a music bed by hand on that stream, without--enroll(pass the--nameflags you want enrolled in a separate call). - Nothing else to set: once a stream has a named speaker, score, segments and meta read
speaker tags in the transcript (the v5 scoring and v3 segments/meta prompts explain them;
a
clipper.tomlthat pins olderprompt_versions gets tags the prompt doesn't expect, so keep the pins current). Streams without names give the same text as before. - Shorts with more than
[scoring] max_source_audio_sof other voices arrive held in review (Review); a show without speaker names isn't checked.
Home · Getting started · clippa doctor · These pages are built from docs/wiki/ in the repo, so edits made here are overwritten: how to edit them
Run it
- Overview
- Getting started
- Roles and services
- Configuration
- Pipeline
- Review
- Reviewing
- War room
- Clippa messenger
- Scheduling and uploads
- Costs
- Checkup
- Audit
- Backups
Install
- Install
- Install checklist
- Kitsu
- Discord app
- YouTube sign-in
- Windows
- macOS
- Transcribe on Modal
- NAS recorder
- NAS hub
- Claude on the NAS
- Phone access
- Model providers
- Adding a show
- YouTube channel
Features
- Pre-shows
- Fetching VODs
- Speakers
- Faces
- Covers
- Cast library
- B-roll
- Clip art
- Weekly issue
- X posts
- TikTok
- News watcher
- Character pieces
- Documentaries
Research
Working on Clippa