Skip to content

v0.35.2

Choose a tag to compare

@github-actions github-actions released this 28 Sep 03:28
· 16 commits to master since this release

A release with no new features in it, closing two things the last two
left open.

Proof that three languages really means three models

0.35.0 said Summo now pairs a specialist with every language you
name rather than only the first. It did — but nothing outside the code
could tell you so, and this is a feature that had already spent
releases quietly doing nothing.

There is now a test that names Vietnamese, English and Japanese and
counts the speech models the daemon says it is running. Both readings,
because they are different claims: what the meeting was configured
with, and what is actually loaded and costing you memory. A version
that picked three models and loaded one used to look identical from
outside; now it fails before it ships.

live:     whisper-base
resolved: gipformer-1.5-68m, parakeet-tdt-110m-en, sense-voice-small
loaded:   gipformer-1.5-68m, parakeet-tdt-110m-en, sense-voice-small

The other half is checked too: naming one language must load
exactly one second model and no more — three decoders is several
hundred megabytes each, and a meeting in one language has no use for
them.

The remaining wait, settled

0.35.1 got pressing record down to about a third of a second for anyone
who pauses a moment first, and said the last 2.9 seconds — building the
speech model — was "a different piece of work". That work is done, and
the answer is that it cannot be made smaller from inside Summo.

Timed at one, two, four, eight and sixteen threads: 2636, 2722, 2704,
2741, 2680 ms.
Flat. It is not thread pools and it is not the disk.
It is ONNX Runtime building the model's graph, and the library Summo
uses offers no way to lower the optimisation level or cache the result.

So the cost gets moved, not shrunk — which is what Summo now does, at
the earliest moment it can know somebody is there. Both tables are
written down in the repository so nobody spends an afternoon rediscovering
this.

Nothing to do when you update. Everything above is a check that runs
before a release rather than something you will see.