Repository navigation
Starlings.Tokenizers 0.3.1
The code of 0.3.1-preview.1 released without a preview suffix, so that a non-prerelease ai-dotnet package can pin it (NuGet NU5104). Only the version and documentation changed.
Behavior
- No change in output for any existing profile: none declares
lstriporrstrip(0.3.0 refused to load such tokenizers), and the same conformance fixtures pass unchanged.