v0.4.1
⚠️ Breaking Change ⚠️
We added a significant change to the model training script scripts/train.py.
- The
--chunk-sizeoption is removed because the bottleneck of memory consumption has shifted due to the overhaul. - The script does not shuffle the input data any more. You need to shuffle the data by yourself using tools such as
shufif needed.
What's Changed
- Faster training with sparse matrix by @tushuhei in #103
- Add
langoption to JS CLI by @tushuhei in #102 - Bump json5 from 2.2.1 to 2.2.3 in /javascript by @dependabot in #104
- Cleanup the training script by @tushuhei in #105
- More accurate Japanese model by @tushuhei in #106
Full Changelog: v0.4.0...v0.4.1