Skip to content

v0.2.0

Choose a tag to compare

View all tags
@github-actions github-actions released this 16 Jul 15:41
· 26 commits to main since this release
v0.2.0
07a7aab

Added

  • Enriched encode results with offsets, sequence ids, overflow encodings, and
    maximum-length status.
  • Added configurable truncation, maximum length, stride, padding, special tokens,
    lowercasing, and tokenizer config loading.
  • Added paired-sequence encoding, paired and configurable batch encoding, and batch
    decoding.
  • Added reproducible HuggingFace Hub loading with revision, authentication, cache,
    and local-only or offline options.

Full Changelog: v0.1.3...v0.2.0

Assets 2
Loading