Skip to content

Starlings.Tokenizers 0.3.1

Choose a tag to compare

@github-actions github-actions released this 19 Oct 20:40
· 46 commits to main since this release
e529a36

The code of 0.3.1-preview.1 released without a preview suffix, so that a non-prerelease ai-dotnet package can pin it (NuGet NU5104). Only the version and documentation changed.

Behavior

  • No change in output for any existing profile: none declares lstrip or rstrip (0.3.0 refused to load such tokenizers), and the same conformance fixtures pass unchanged.