Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enforce all objects in the main init are documented #9014

Merged
merged 2 commits into from
Dec 10, 2020
Merged

Conversation

sgugger
Copy link
Collaborator

@sgugger sgugger commented Dec 9, 2020

What does this PR do?

Some objects added by contributors or the team are regularly forgotten. This PR changes the script that inspects whether or not models are documented to encompass all objects in the main init (and adds documentation for multiple forgotten objects).

Copy link
Member

@LysandreJik LysandreJik left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks for being so rigorous!

Comment on lines +374 to +391
SHOULD_HAVE_THEIR_OWN_PAGE = [
# bert-japanese
"BertJapaneseTokenizer",
"CharacterTokenizer",
"MecabTokenizer",
# Bertweet
"BertweetTokenizer",
# Herbert
"HerbertTokenizer",
"HerbertTokenizerFast",
# Phoebus
"PhobertTokenizer",
# Benchmarks
"PyTorchBenchmark",
"PyTorchBenchmarkArguments",
"TensorFlowBenchmark",
"TensorFlowBenchmarkArguments",
]
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These are the ones we should work on then?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes! Will open issues once this PR is merged.

@sgugger sgugger merged commit 1310e1a into master Dec 10, 2020
@sgugger sgugger deleted the document_them_all branch December 10, 2020 16:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants