Highlights
9B Achieves 17/17 at All Quantizations
The full 9B T01-T17 trial is complete. Every quantization variant (Q4, Q5, Q6, Q8, BF16) passes all 17 agentic tasks β code generation, JSON round-trip, error recovery, multi-source synthesis, everything. 9B is the gold standard for local agentic tool use.
| 9B Variant | Score | Turns | Time |
|---|---|---|---|
| 9B-Q4 | 17/17 | 38 | 9127s |
| 9B-Q5 | 17/17 | 49 | 14239s |
| 9B-Q6 | 17/17 | 39 | 8642s |
| 9B-Q8 | 17/17 | 39 | 17324s |
| 9B-BF16 | 17/17 | 43 | 15722s |
Security and Correctness Fixes
- OAIResponse use-after-free β
send()now dupes all string fields before returning (previously returned dangling pointers into freed JSON parse tree) - Config save malformed JSON β
save()rewrote usingstd.fmtinstead of broken manual string concatenation - getToolCalls page_allocator leak β replaced leaking ArrayList with proper allocator-based allocation
- Auth header memory leak β
Bearer {key}string now freed after HTTP request
igllama v0.3.11
- Strip residual
</think>tokens when--no-thinkis active (both streaming and non-streaming paths)
Verified
- 195/195 tests pass, 0 leaks
- GH Pages rebuilt and deployed