Skip to content

v0.7.0

Choose a tag to compare

@github-actions github-actions released this 20 Oct 20:47
· 20 commits to main since this release

giq 0.7.0 adds typed decisions: POST /decide takes a record, up to two photos and typed questions, and returns calibrated probabilities through imajev-2b. LLM recipes can also replace the checkpoint's chat template, and every release now carries its licences, file by file. Thanks to @ewuerger for both features (#3, #4); integration, packaging and licensing by @vik378.

New

  • Decide: a new modality and the curated giq-imajev plugin (#4).
    • POST /decide takes a record (text or JSON), 0-2 photos and 1-8 typed questions: choice, noul (yes/no), score and multi. Each answer carries a probability per option, unknown_probability (the model's trained can't tell) and abstained. Act above a threshold you measured on your own cases; send abstentions to a person.
    • It runs on imajev-2b: Qwen3.5-2B plus a LoRA and a 255-code decision readout, both Apache-2.0. rotations (1-4) averages over option orders.
    • The engine runs on its own interpreter, set up once with cd envs/imajev && uv sync; it installs imajev at a pinned commit.
    • On an RTX 5060 Ti it loads in 4 s and takes 4.5 GiB, answering a text question in about 40 ms and a photo question in about 60 ms once warm. Sleepy: it loads on demand and can be evicted.
    • The sandbox has a Decide tab: a JSON editor for the record and questions, photo upload, and the answers with their probabilities.
  • params.chat_template_file for llama.cpp and vllm recipes (#3).
    • It names a Jinja file, resolved like weights.path, that replaces the checkpoint's own chat template. llama.cpp gets it as --chat-template-file, vllm as --chat-template. Unset, nothing changes.
    • It exists for the fixed Qwen templates: the stock Qwen 3.8 template defaults to xhigh reasoning and breaks on tool-call arguments sent as a JSON string, the OpenAI wire shape. See Chat templates for what was checked, and why it is opt-in per recipe.
  • Licences travel with every copy.
    • Each plugin wheel now carries LICENSES/, as core's already did; CI fails a build where one doesn't.
    • The release has giq-0.7.0.spdx, an SPDX bill of materials of every file's copyright and licence, generated from the REUSE headers and listed in SHA256SUMS.

Upgrading

  • From 0.6.x: check out v0.7.0 and run make sync, or install the 0.7.0 wheels from this release. Every package moves to 0.7.0 together, and giq-defaults now includes giq-imajev.
  • To use decide: cd envs/imajev && uv sync, then fetch imajev-2b from the Add page or with giq add. Without that interpreter the plugin still loads, the imajev engine shows as missing, and nothing else changes.

Full changelog: v0.6.1...v0.7.0