Repository navigation
Releases
Releases · DVDAGames/pgn-tokenizer
v1.0.0
v1.0.0 (2026-03-23)
This release is published under the MIT License.
Features
- Add typescript package (
fcc5b4e)
Detailed Changes: v0.1.6...v1.0.0
v0.1.6
v0.1.6 (2025-03-27)
This release is published under the MIT License.
Bug Fixes
- Properly split test and validation data; update packages (
769f2a5)
Detailed Changes: v0.1.5...v0.1.6
v0.1.5
v0.1.5 (2025-02-11)
This release is published under the MIT License.
Bug Fixes
- Go back to original tokenizer config (
7371553)
Adding a comment to trigger a new deployment because chore types don't publish, but fix types do.
Chores
-
Remove normalizer from training pipeline (
75e25fd) -
Revert to NFD normalizer because otherwise tokens are janky (
fa2b851) -
Temporarily remove HF pubish script (
5e267d0)
Detailed Changes: v0.1.4...v0.1.5
v0.1.4
v0.1.4 (2025-02-11)
This release is published under the MIT License.
Bug Fixes
- Convert NFD normalizer to NFC normalizer (
33df3c5)
Transformers.js doensn't support NFD tokenizers.
Chores
- Add model card template (
35e3c77)
Detailed Changes: v0.1.3...v0.1.4
v0.1.3
v0.1.3 (2025-01-25)
Bug Fixes
- Get correct version in pyproject (
b48786d)
Detailed Changes: v0.1.2...v0.1.3
v0.1.2
v0.1.2 (2025-01-25)
Bug Fixes
- Try to sync version numbers across the CI/CD pipeline (
de5f449)
Detailed Changes: v0.1.1...v0.1.2
v0.1.1
v0.1.1 (2025-01-25)
Bug Fixes
- Add MIT LICENSE file and pyproject.toml config (
07be1da)
Chores
Detailed Changes: v0.1.0...v0.1.1