Skip to content

0.21.0

SKaiNET-transformers 0.21.0
@michalharakal michalharakal tagged this 29 Apr 08:49 
Mirrors SKaiNET 0.21.0. Highlights:

- SKaiNET 0.21.0 dependency: Panama Vector FP32 matmul kernel auto-discovered
  via ServiceLoader, ScratchPool SPI for runtime workspace allocation, Q4_K
  SIMD-fused kernel + SPI, Q6_K SIMD dequant, Q4_0 partial-vec dot, canonical
  ggml layout for Q4_K/Q5_K, FP32 MemSeg arena leak fix, TensorOps.permute.
- ScratchPool wired into kllama batched-prefill attention output and the BERT
  encoder forward — pooling is opt-in via PooledExecutionContext, default
  NoopScratchPool preserves existing behavior.
- First-class Java surface for Llama tool calling: KLlamaJava + KLlamaSession
  + JavaTool + JavaTools.definition + JavaAgentLoop, exercised end-to-end by
  llm-test:llm-test-java and llm-apps:kllama-java-sample.
- Removed deprecated-runtime CLIs: kqwen-only, kapertus-cli, kvoxtral-cli.
  Qwen now goes through skainet-cli or kllama-cli (same tensor layout).
- Antora docs site populated with Divio quadrants — Getting Started (Kotlin
  and Java), Tool Calling (generic + Llama 3 family), Embeddings, Smoke
  Tests, plus how-to and explanation pages.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Assets 2
Loading