Repository navigation
v0.37.0
Both halves of the last report, which the previous release only answered
one of.
A decoder for every language you name
"Khai vi+en thì chạy whisper vi+en thôi — chạy zh he ja làm gì? Lọc ra
ok nhưng mà không đúng."
Right, and for a harder reason than 0.36 treated it as. Whisper's
language setting is not a label on the output — it is the decoder's
prompt. Left free it detects across ninety-nine languages and then
decodes as whichever it picked, so a Vietnamese sentence it guessed was
Chinese comes back in Chinese characters. Correcting the label
afterwards cannot un-write the text. Filtering was treating the symptom.
Now every language you name has a decoder built for it. A language with a
specialist uses the specialist. A language with none — English, on the
meeting that was reported — gets the multilingual model pinned to it,
and pinned it cannot wander:
refining with models=["gipformer-1.5-68m", "whisper-tiny[en]"]
Driven entirely by what you declare. Name three languages and three
decoders appear; name one and nothing is pinned at all.
Translating sentences, not the pieces silence cut them into
"Dịch 1 câu thì dễ sai… dịch thì phải dịch đủ câu."
Summo cuts audio on silence, not on sentence ends, so what reached
the translator was very often half a thought — Hoặc là anh bảo việt anh bận tí thì. Half a thought in, half a translation out.
The obvious rule, waiting for a full stop, fails exactly where it is
needed: the Vietnamese model emits no punctuation at all. A version
that waited for one reached a test run and was thrown away — every
Vietnamese subtitle paid the full delay and then arrived in
240-character blocks.
So the boundary is the pause, which is on every line already and
needs no model to produce it. Three rules keep it free in the common
case: a line long enough to stand on its own goes immediately;
punctuation only ever sends sooner; and a change of language ends the
sentence, because two people taking turns is not one sentence.
A fragment nobody finishes waits 1.2 seconds and goes as it stands. A
late subtitle of half a sentence beats none.
What this cost, honestly
A sentence that is still being assembled delays its own subtitle until
it finishes. For the model Vietnamese meetings use, most lines are whole
clauses already and are not delayed at all. Short fragments are — that
is the trade, and it is the one that was asked for.