Skip to content

ModelJars 0.1.48

Choose a tag to compare

View all tags
@bsbodden bsbodden released this 17 Sep 22:18
· 48 commits to main since this release
v0.1.48
4533937
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

ModelJars 0.1.48

First qualified hybrid composition.

  • New composite recipe module org.modeljars.composite:granite-answerability: a typed facade for the Granite 4.1 3B answerability hybrid. It opens the qualified Q4_K_M base and the Integrallis-trained answerability activated LoRA through the public API, sharing one physical KV prefix. Callers need --enable-native-access=ALL-UNNAMED.
  • Catalog composition granite_4_1_3b_answerability_hybrid, qualified on evidence in integrallis/models at 3ca004e8:
    • a clean-host run on a fresh machine with both markers resolved from Maven Central, 12 of 12 measurements byte-identical to the qualification arms;
    • SQuAD v2 dev 0.878 and MS MARCO v2.1 validation 0.833 on evidence-confirmed labels, against base scores of 0.529 and 0.515, structured and physically shared on all 200 cases per suite;
    • kernel identity 10 of 10 per suite against pure Java;
    • 50.2% lower latency at a 4,096-token prefix, with unique inference state down from 2.01 GB to 0.68 GB.
  • Scope: single-turn answerability on the rust-ffm backend. Multi-turn is not qualified, and on the original dataset labels the MS MARCO suite scores 0.725.

Models runtime: 0.3.42.

Assets 22
Loading