LokalBot 0.10.4

What’s new

• Better autocomplete in English and Serbian Latin. The hybrid decoder is now the standard whenever autocomplete is enabled, with improved partial-word completion and no extra experimental toggle. Gemma E2B remains the default local model.
• Less waiting for suggestions. The optimized hybrid reduced mean native generation time from 67.0 to 51.6 ms and p95 from 142.4 to 98.9 ms in the same-model, same-prompt benchmark. All 1,496 paired non-cancelled outputs matched. These are M4 Max measurements against the earlier hybrid; they exclude model loading, debounce, accessibility reads and overlay presentation. Benchmark and limits.
• More reliable suggestion placement. Improved on-screen caret detection, text-size matching and positioning keep ghost text aligned with what you type, including fixes tested in Chrome and Viber.
• Optional Fun-ASR-Nano transcription. Select a local Fun-ASR-Nano-2512 sherpa-onnx model folder in Models → Transcribe. LokalBot validates the folder and reads its weights in place; existing transcription choices are preserved.

Autocomplete preview

A 39-second preview with English and Serbian Latin before/after examples and the measured speed improvement. The typing scenes replay synthetic benchmark cases.

lokalbot-autocomplete-release.mp4

Explore the public interactive autocomplete tour.

After updating

Autocomplete remains optional and runs locally. Its improved decoder is used automatically when the feature is enabled. E2B stays the default, and your transcription model selection is preserved. Fun-ASR-Nano is an optional local model-folder choice.

Full changelog: v0.10.3...v0.10.4