v0.3.0

What's Changed

• chore: Update email by @Pringled in #43
• Migrate crate to Rust 2024 edition by @seuros in #44
• Avoid serializing tokenizer to read unknown-token metadata by @seuros in #46
• Share immutable model state across clones by @seuros in #47
• Make Clap CLI opt-in with a cli feature by @seuros in #48
• Deduplicate model construction and reuse library in CLI by @seuros in #49
• Deduplicate float decoding and model layout candidates by @seuros in #50
• fix: Drop unknown token for Unigram tokenizers, prepare release by @Pringled in #52

New Contributors

• @seuros made their first contribution in #44

Breaking changes

• The CLI is now opt-in. Clap is no longer a default dependency. To install the binary, use:

  cargo install model2vec-rs --features cli
  

Full Changelog: v0.2.1...v0.3.0