Skip to content

Commit

Permalink
Update tokenizers requirement from <0.16,>=0.10 to >=0.10,<0.20
Browse files Browse the repository at this point in the history
Updates the requirements on [tokenizers](https://github.com/huggingface/tokenizers) to permit the latest version.
- [Release notes](https://github.com/huggingface/tokenizers/releases)
- [Changelog](https://github.com/huggingface/tokenizers/blob/main/RELEASE.md)
- [Commits](huggingface/tokenizers@rust-v0.10.0...v0.19.1)

---
updated-dependencies:
- dependency-name: tokenizers
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
  • Loading branch information
dependabot[bot] committed Apr 18, 2024
1 parent 74a7e36 commit 8bcb050
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion pyproject.toml
Original file line number Diff line number Diff line change
Expand Up @@ -32,7 +32,7 @@ dependencies = [
"sentencepiece",
"tensorboardx",
"torchmetrics >= 0.9, < 2.0",
"tokenizers >= 0.10, < 0.16",
"tokenizers >= 0.10, < 0.20",
"tomli",
"torch >= 2.0, < 2.3",
"transformers >= 4.19.0, < 5.0.0, != 4.23.0, != 4.23.1",
Expand Down

0 comments on commit 8bcb050

Please sign in to comment.