perf: add scaling benchmark — FastBPE is 7-12x faster than graph BPE#18
Closed
perf: add scaling benchmark — FastBPE is 7-12x faster than graph BPE#18
Conversation
2 tasks
AmitMY
force-pushed
the
perf/larger-benchmarks
branch
15 times, most recently
from
81e451c to
887b986
Compare
- bench_scaling.py compares graph BPE vs FastBPE across text sizes (5k-270k chars) and merge counts (50-200) - FastBPE consistently 7-12x faster, identical merge output - Add scaling tests: 270k chars in <5s, identical merges across sizes Results (270k chars, 200 merges): Graph 1.8s vs Fast 0.23s (7.9x) Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
AmitMY
force-pushed
the
perf/larger-benchmarks
branch
from
887b986 to
6e71789
Compare
Contributor
Author
|
Closing — the scaling benchmark was built on FastBPETrainer which was removed in #13. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
bench_scaling.pycomparing graph BPE vs FastBPE across text sizes and merge countsStacked on #17.
What improved
Results
Test plan
ruff check .passes🤖 Generated with Claude Code