Skip to content

3.50.0

Choose a tag to compare

@fernandotonon fernandotonon released this 09 Oct 01:01

AI Chat that works out of the box, and a refreshed local model list.

AI Chat loads its model for you (#1086)

Users downloaded Qwen or Gemma models and the chat stayed silent: nothing told them a model had to be loaded, and the Load button was buried in a settings dialog.

  • Opening the AI Chat loads a model. It picks the last one you used, else a model recommended for the agent, else the first one downloaded. If you have none yet, it loads as soon as a download finishes.
  • Nothing is loaded at app startup. A model can take gigabytes of memory, and most sessions never use the AI.
  • Model picker in the chat header, like Ollama's. Switch models, Unload model (free memory), or Download models…. A status line explains what is happening: loading, a load error, or no model yet, with a one-click action.
  • To turn auto-loading off, untick Load the last model when the AI Chat opens in AI → AI Model Settings.

Models now get their own chat format

Every model used to receive the same generic prompt format, whatever format it was trained on. On Qwen 3.5 that format never ended the model's turn: it answered, then kept inventing new user/assistant turns until it hit the token limit, so the agent got no usable reply. Prompts now use each model's own template (Qwen/ChatML, Gemma 2/3, Gemma 4, Llama 3, and anything else llama.cpp recognises), and the model answers once and stops.

The newer "thinking" models (Qwen 3.5/3.6, Gemma 4) are run with thinking switched off, so the agent's token budget goes to the answer.

Refreshed model list (all Apache-2.0)

Model Download Notes
Gemma 3 1B 0.8 GB smallest option
Qwen 3.5 4B 2.7 GB recommended agent model, 8 GB machines
Gemma 4 E4B 5.0 GB all-rounder, 8 GB machines
Qwen 3.5 9B 5.7 GB stronger agent model, 16 GB machines
Gemma 4 12B 7.1 GB strong on long multi-step tasks, 16 GB
Qwen 3.6 27B 16.8 GB top-tier, 24 GB
Gemma 4 26B-A4B 17 GB mixture-of-experts, fast, 24 GB
Qwen 3.6 35B-A3B 22 GB strongest, 32 GB

Gemma 3 4B/12B/27B, Llama 3.2 3B, Qwen 2.5 and Qwen3 2507 were removed from the download list. Copies you already downloaded still show up in the picker and keep working.