-
Notifications
You must be signed in to change notification settings - Fork 301
Closed
Labels
stat:contributions welcomeAdd this label to feature request issues so they are separated out from bug reporting issuesAdd this label to feature request issues so they are separated out from bug reporting issuestype:featureNew feature or requestNew feature or request
Description
In #653 we added a masked language modeling task for RoBERTa. We can make a similar change for the XLMRoberta
model.
- Update
XLMRobertaTokenizer
to expect a mask token. - Add a
XLMRobertaMaskedLMPreprocessor
preprocessor layer and tests. - Add a
XLMRobertaMaskedLM
task model and tests. - Update
keras_nlp/models/__init__.py
to exportXLMRobertaMaskedLM
andXLMRobertaMaskedLMPreprocessor
.
Metadata
Metadata
Assignees
Labels
stat:contributions welcomeAdd this label to feature request issues so they are separated out from bug reporting issuesAdd this label to feature request issues so they are separated out from bug reporting issuestype:featureNew feature or requestNew feature or request