Skip to content

Autobot 1.6.3

Choose a tag to compare

View all tags
@wckdboy wckdboy released this 16 Oct 18:55
· 276 commits to main since this release
v1.6.3
37346a8

On-device chat is fixed and much faster: no more failures every other turn, follow-up replies start almost at once, and Stop takes effect immediately.

Fixed (both platforms)

  • The default on-device chat models failed every other turn. Qwen3.5 0.8B, 2B and 4B use recurrent layers whose memory can't be rewound to an arbitrary point. The engine ignored that, so every second message ended in "DECODE_FAILED", and the next one re-read the whole conversation. The engine now keeps snapshots of that memory (after the system prompt, and near the end of each prompt) and resumes from the newest usable one. Replies are identical to a fresh run.

Faster

  • Follow-up replies start in well under a second. The conversation already processed is reused, so the model reads only your new message. On a Mac GPU with a 3,000-token agent prompt, the second turn now starts in about 0.1 s instead of failing or re-reading for 1–2 s. On CPU, 5–8 s per turn becomes 0.1–0.5 s.
  • New chats with the same agent reuse its system prompt and tools, so the first reply comes sooner too.
  • The model loads when you open a chat, while you type, instead of when you press Send. It holds off while an image, audio or dictation job runs.
  • Text appears sooner: tokens are shown as soon as they're sampled, and the first words up to two tokens earlier.

Stop means stop

  • Stop while the model reads your prompt now takes effect in milliseconds (it could take over 7 s on CPU).
  • Stop during model loading cancels the load.
  • Android: a Stop pressed while a reply was waiting or loading could be lost, so the phone generated a full answer for nobody. A finished reply's Stop could also cancel the next one. Each reply is now stopped on its own.

Files

  • autobot-1.6.3-release.apk: signed release (ai.wckd.autobot, arm64-v8a, Android 14+). Signer certificate SHA-256 9a1378acf9587885e7920355558c85a1ec0e89304f58c153feebf90fdee7f3f1.
  • autobot-1.6.3-debug.apk
  • autobot-1.6.3-mapping.txt: R8 mapping, for reading crash reports
  • SHA256SUMS.txt

iOS: TestFlight build 1.6.3.

Assets 6
Loading