Skip to content

v1.0.7

Choose a tag to compare

@hyunhomon hyunhomon released this 25 Aug 22:25
· 7 commits to main since this release

v1.0.7

Model call stability patch: fix empty responses on Qwen models.

Fixed

  • Empty model responses ("Model returned an empty response") on Qwen models.
    The Qwen harness sampled with temperature: 0.0 and a fixed seed, so when
    the model emitted EOS as the first token, every retry deterministically
    repeated the same empty output. Qwen now samples at temperature: 0.2, and
    empty-response retries change the sampling seed so the model draws a
    different token path. Gemma models were unaffected (already sampling at
    temperature: 1.0).
  • Model requests no longer fall back repeatedly and end with "빈 응답"
    (empty response). The request chain introduced in v1.0.6 retried each
    format with and without num_predict (up to six attempts per frame) and
    still surfaced an empty-response error when all attempts returned empty
    content. Requests now use the v1.0.3 order — structured schema, "json",
    plain — and return the first successful response as-is.
  • Removed the dead empty-response failure classification from the analysis
    batch pipeline; empty model text is now reported as a frame-level parse
    failure, matching v1.0.3 behavior.

Kept from v1.0.6

  • Timeout resilience for low-spec PCs: 600s request timeout with one retry,
    and timeouts are excluded from the consecutive-failure abort threshold.
  • Structured Ollama error classification (timeout, connection,
    model-not-installed, non-vision, out-of-memory).
  • Stricter risk judging prompts and the empty-text parse guard.

Included

  • Bundled Ollama and FFmpeg runtimes; no separate Ollama installation is required.
  • In-app vision model download, hardware recommendation, installation, and selection.
  • Model-specific prompt harnesses for supported Qwen3-VL and Gemma 4 variants.