Skip to content

Chaty v0.4.0

Choose a tag to compare

@Fangyuan025 Fangyuan025 released this 06 Jun 22:18
· 24 commits to main since this release

Chaty v0.4.0

New

  • In-app auto-update. Chaty now checks GitHub for a newer release on launch and offers a one-click update (downloads and runs the installer).
  • Context-usage meter. The stats line shows how full the model's context window is (ctx 3.2K/8K with a bar).

Fixes

  • Model switching no longer crashes. Switching models could fail with "failed to initialize inference context: null reference" — the old model is now freed first, and a failed context allocation backs off the GPU offload instead of erroring out.
  • Better model compatibility. Some models (e.g. certain Qwen variants) failed on the 2nd turn with a decode error and then stayed broken — prompt decoding now falls back to a clean re-decode and self-recovers, so more models work reliably.
  • No more date‑reciting. The "today's date" hint is only sent when your question is actually time-related, so short prompts no longer make the model recite the date.
  • Thinking mode is only used (and only injects /no_think) when the model actually supports reasoning; it's disabled in the menu otherwise.
  • Thinking and Web search are now mutually exclusive (enabling one turns the other off).
  • Live mode now shows only the sentence currently being spoken, in a larger font (the full transcript is saved to the chat as before).

Install (Windows x64)

Download Chaty_0.4.0_x64-setup.exe below and run it (per-user, no admin). After this version, future updates are offered in-app.