Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Encode speed improvement #11

Merged
merged 6 commits into from
Jul 1, 2023
Merged

Encode speed improvement #11

merged 6 commits into from
Jul 1, 2023

Conversation

dmitry-brazhenko
Copy link
Owner

@dmitry-brazhenko dmitry-brazhenko commented Jul 1, 2023

In this PR

  1. Significantly improved Encoding speed (changed hash function)
  2. Added test for PRs pipeline
  3. Some minor changes

@dmitry-brazhenko dmitry-brazhenko linked an issue Jul 1, 2023 that may be closed by this pull request
@dmitry-brazhenko dmitry-brazhenko merged commit 91735fe into main Jul 1, 2023
@dmitry-brazhenko dmitry-brazhenko deleted the fix/speed_impr branch July 1, 2023 11:17
dmitry-brazhenko added a commit that referenced this pull request Aug 30, 2023
* readme nice shields

* csproj fixes

* hash function improved + moved some stuff to Sharptoken.lib

* 1. renamed main pipeline
2. added PR test pipeline

* fix shields for README.md

* no .Lib namespace
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Performance compared to TiktokenSharp, Tokenizer
1 participant