Skip to content

v0.3.2 β€” 9B 17/17 Measured, Security Fixes, igllama v0.3.11

Latest

Choose a tag to compare

@bkataru bkataru released this 06 Mar 10:13
· 3 commits to main since this release

Highlights

9B Achieves 17/17 at All Quantizations

The full 9B T01-T17 trial is complete. Every quantization variant (Q4, Q5, Q6, Q8, BF16) passes all 17 agentic tasks β€” code generation, JSON round-trip, error recovery, multi-source synthesis, everything. 9B is the gold standard for local agentic tool use.

9B Variant Score Turns Time
9B-Q4 17/17 38 9127s
9B-Q5 17/17 49 14239s
9B-Q6 17/17 39 8642s
9B-Q8 17/17 39 17324s
9B-BF16 17/17 43 15722s

Security and Correctness Fixes

  • OAIResponse use-after-free β€” send() now dupes all string fields before returning (previously returned dangling pointers into freed JSON parse tree)
  • Config save malformed JSON β€” save() rewrote using std.fmt instead of broken manual string concatenation
  • getToolCalls page_allocator leak β€” replaced leaking ArrayList with proper allocator-based allocation
  • Auth header memory leak β€” Bearer {key} string now freed after HTTP request

igllama v0.3.11

  • Strip residual </think> tokens when --no-think is active (both streaming and non-streaming paths)

Verified

  • 195/195 tests pass, 0 leaks
  • GH Pages rebuilt and deployed