Speed up default BERT testing roughly 3x #859
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
Once we are good with an approach, I will open a contributor issue to replicate. |
Overall, our model testing is getting unwieldy and slow. This speeds up the default testing for BERT where we can. - Models are created as small as possible. - Most testing is down with XLA, with only a single test for each model with jit_compile=False. - Saved model testing is marked large, with a much faster serialization test added that will run by default.
mattdangerw
force-pushed
the
bert-testing
branch
from
7e58317 to
4784106
Compare
fchollet
approved these changes
Mar 17, 2023
5 tasks
kanpuriyanawab
pushed a commit
to kanpuriyanawab/keras-nlp
that referenced
this pull request
Mar 26, 2023
* Speed up default BERT testing roughly 3x Overall, our model testing is getting unwieldy and slow. This speeds up the default testing for BERT where we can. - Models are created as small as possible. - Most testing is down with XLA, with only a single test for each model with jit_compile=False. - Saved model testing is marked large, with a much faster serialization test added that will run by default. * Address comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Overall, our model testing is getting unwieldy and slow. This speeds up the default testing for BERT where we can.