Repository navigation
0.6.0
Changes since the last Release
Changed
- Update llama.cpp to b11429 (v0.6.0, from b11146).
GET /v1/modelsentries gain anarchitectureobject withinput_modalities/output_modalities.LLAMA_STATE_SEQ_VERSIONwent from 3 to 4, so restoring a slot file saved with--slot-save-pathbefore this update returns 400. Save it again.
Added
-
servebindsPOST /v1/systemone, upstream's TypeSafe System One API for native decision models (laya, clef, openjev, lev, kev, nimble). It answers typedchoice/score/noulquestions with probabilities. Other models get 501, as upstream.make testcovers Laya, Kev and lev when their GGUFs are inmodels/. -
serve --embeddings-mmprojand--embeddings-poolingconfigure the--enable-embeddingsmodel. The mmproj enables upstream's new{"content": [...]}input on/v1/embeddings, with image, audio and video parts. The pooling flag lets a generative VLM serve as the embedder: it has no pooling metadata, and/v1/embeddingsrejects poolingnone. Both flags require--enable-embeddings. -
chimera gen --statsprints prompt and generated token counts, the wall-clock time of each phase, and the tokens/s of each to stderr after generating. The table layout matches cyllama'sgen --stats, sorat.pyandrwt.pyparse one format. The generation rate excludes prompt time, as inchat's per-turn line; cyllama's singleTokens/secondrow is generated tokens over total time, so the two are not comparable andchimeranames its rowsPrompt tokens/secondandGeneration tokens/secondinstead. Timing usesstd::chronoaround the prompt decode and the sample loop rather than llama.cpp's perf counters, whichnew_llama_contextturns off. -
rat.pyrecords everytestrun in a SQLite database shared with cyllama's and inferna'srwt.py. The default path is~/config/runs/db.sqlite;$RUNS_DBoverrides it and--no-recordturns it off. Each run stores target, backend, version, the sha256 of the binary, git commit, host, wall time and exit code. Each case stores its status (pass, fail, timeout or skip) and seconds. A gen case also stores the numbers fromgen --stats, when the binary has it (tokens/s per phase among them). Each image an sd case writes stores its size and sha256; the seed is fixed, so an unchanged hash means an identical image. Rows are written as each case ends, so an interrupted run keeps its finished cases.runs diffcompares two runs case by case;rat.py reportwrites an HTML report and opens it in the browser. It opens with a version comparison: per backend and target, the newest version against the next one below it, with a regression verdict per case.rat.py run --version Xrecords a baseline from an older release. Seedocs/dev/rat.md.rat.py runs # recent runs of this project rat.py runs diff # latest run vs the previous one with the same backend and target rat.py runs diff 12 15 # any two runs, across projects too
Fixed
-
Malformed or mistyped request JSON returns 400, not 500.
json::parsethrowscommon_json_error, astd::runtime_error, which the route wrapper mapped to 500. Upstream maps it to 400 as of b11429. -
scripts/test_fixtures.pyforwards options such as--no-colortotest.py. It rejected them as unrecognized arguments, contrary todocs/dev/maintenance.md. -
make depsre-clones a source tree left at a ref other than its pin. An existingbuild/<project>clone was reused as-is, so pulling a pin bump into a checkout that had already built the old one kept building the old ref; the pin-checkstatic_asserts then failed on fields the old headers lack. A clone with edits outsidescripts/patches/is left in place and the build stops, naming the edited files.