Skip to content

fix(data): correct length filtering from character to token level#548

Merged
zhuzilin merged 1 commit intoTHUDM:mainfrom
yuzhu-cai:yzc
Oct 23, 2025
Merged

fix(data): correct length filtering from character to token level#548
zhuzilin merged 1 commit intoTHUDM:mainfrom
yuzhu-cai:yzc

Conversation

@yuzhu-cai
Copy link
Contributor

Replace character-based length filtering with token-based

@zhuzilin zhuzilin merged commit 79fd101 into THUDM:main Oct 23, 2025
llltttwww pushed a commit to llltttwww/slime that referenced this pull request Nov 30, 2025
Yangruipis pushed a commit to rednote-ai/slime that referenced this pull request Feb 28, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants