Skip to content

Conversation

@ChristianWLang
Copy link
Contributor

Summary: This diff extends the pytorch tokenizers.

Reviewed By: larryliu0820

Differential Revision: D70786405

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Meta Open Source bot. label Mar 11, 2025
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D70786405

@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D70786405

ChristianWLang added a commit to ChristianWLang/tokenizers that referenced this pull request Mar 13, 2025
Summary:

This diff extends the pytorch tokenizers.

Reviewed By: larryliu0820

Differential Revision: D70786405
Summary:
Pull Request resolved: meta-pytorch#27

This diff extends the pytorch tokenizers.

Reviewed By: larryliu0820

Differential Revision: D70786405
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D70786405

@facebook-github-bot facebook-github-bot merged commit 8328fa0 into meta-pytorch:main Mar 13, 2025
5 of 6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Meta Open Source bot. fb-exported

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants