Skip to content

runNburn v0.6.1

Choose a tag to compare

View all tags
@github-actions github-actions released this 02 Aug 06:15
v0.6.1
d1d26de

runNburn 0.6.1 hardens GGUF parsing and tokenizer construction. It fixes valid-file compatibility, rejects malformed metadata before unsafe allocation or inference, and removes silent tokenizer fallbacks that could produce incorrect token streams.

Fixed

  • Decode the standard GGUF uint64, int64, and float64 metadata type IDs correctly, accept only canonical boolean encodings, and use checked integer conversions instead of wrapping negative or oversized values.
  • Validate GGUF alignment, header counts, metadata keys, tensor names and dimensions, quantized row block sizes, tensor data bounds, and MTP1 sidecar ranges without panicking.
  • Accept valid aligned gaps between tensor payloads instead of requiring every tensor to begin immediately after the previous padded range.
  • Reject big-endian GGUF files explicitly because the current mmap-backed tensor runtime consumes little-endian GGML payloads.
  • Bound string and array allocations before materialization and reject duplicate metadata keys or tensor names.
  • Propagate type errors from optional architecture metadata instead of treating malformed present values as missing.
  • Reject empty atomic tokenizer tokens before they can cause a non-advancing tokenization loop and unbounded memory growth.

Tokenizer compatibility

  • Preserve GGUF token types, added tokens, tokenizer pre-type metadata, and BOS/EOS/UNK/SEP/PAD identifiers.
  • Use explicit unknown, control, user-defined, and added-token metadata for atomic tokenization instead of relying on delimiter-shaped token text.
  • Remove generated <tok_N> placeholder vocabularies and the unknown-tokenizer-to-SentencePiece fallback.
  • Fail during model loading for missing vocabularies, unsupported tokenizer models, Hugging Face JSON-only tokenizers, malformed merge rules, out-of-range special-token IDs, duplicate tokens, and unsupported add-EOS/add-SEP policies.

Verification

  • rnb-loader: 104 tests passed.
  • rnb-llm: 464 passed, 5 ignored.
  • rnb-backend-cuda --lib: 624 passed, 45 ignored.
  • Metal-excluded workspace: 2039 passed, 65 ignored.
  • Qwen3.6 and Gemma4 GGUF metadata loading passed, and a Gemma4 E2B product chat smoke completed tokenizer construction, model loading, and one-token generation.
  • CI and all 10 release jobs passed.
  • Release assets contain nine archives and nine matching SHA-256 files.

Full changelog: v0.6.0...v0.6.1

Assets 20
Loading