Repository navigation
v0.7.0
giq 0.7.0 adds typed decisions: POST /decide takes a record, up to two photos and typed questions, and returns calibrated probabilities through imajev-2b. LLM recipes can also replace the checkpoint's chat template, and every release now carries its licences, file by file. Thanks to @ewuerger for both features (#3, #4); integration, packaging and licensing by @vik378.
New
- Decide: a new modality and the curated
giq-imajevplugin (#4).POST /decidetakes a record (text or JSON), 0-2 photos and 1-8 typed questions:choice,noul(yes/no),scoreandmulti. Each answer carries a probability per option,unknown_probability(the model's trained can't tell) andabstained. Act above a threshold you measured on your own cases; send abstentions to a person.- It runs on imajev-2b: Qwen3.5-2B plus a LoRA and a 255-code decision readout, both Apache-2.0.
rotations(1-4) averages over option orders. - The engine runs on its own interpreter, set up once with
cd envs/imajev && uv sync; it installs imajev at a pinned commit. - On an RTX 5060 Ti it loads in 4 s and takes 4.5 GiB, answering a text question in about 40 ms and a photo question in about 60 ms once warm. Sleepy: it loads on demand and can be evicted.
- The sandbox has a Decide tab: a JSON editor for the record and questions, photo upload, and the answers with their probabilities.
params.chat_template_filefor llama.cpp and vllm recipes (#3).- It names a Jinja file, resolved like
weights.path, that replaces the checkpoint's own chat template. llama.cpp gets it as--chat-template-file, vllm as--chat-template. Unset, nothing changes. - It exists for the fixed Qwen templates: the stock Qwen 3.8 template defaults to
xhighreasoning and breaks on tool-call arguments sent as a JSON string, the OpenAI wire shape. See Chat templates for what was checked, and why it is opt-in per recipe.
- It names a Jinja file, resolved like
- Licences travel with every copy.
- Each plugin wheel now carries
LICENSES/, as core's already did; CI fails a build where one doesn't. - The release has
giq-0.7.0.spdx, an SPDX bill of materials of every file's copyright and licence, generated from the REUSE headers and listed inSHA256SUMS.
- Each plugin wheel now carries
Upgrading
- From 0.6.x: check out
v0.7.0and runmake sync, or install the 0.7.0 wheels from this release. Every package moves to 0.7.0 together, andgiq-defaultsnow includesgiq-imajev. - To use decide:
cd envs/imajev && uv sync, then fetchimajev-2bfrom the Add page or withgiq add. Without that interpreter the plugin still loads, theimajevengine shows as missing, and nothing else changes.
Full changelog: v0.6.1...v0.7.0