-
Notifications
You must be signed in to change notification settings - Fork 301
Modify README of bert example #174
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
chenmoneygithub
commented
May 9, 2022
- Fix the curl command, and add curl instruction for vocab downloading.
- Add output flag for glue_fine_tuning script.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good! Few nits.
examples/bert/README.md
Outdated
[here](https://storage.googleapis.com/tensorflow/keras-nlp/examples/bert/bert_vocab_uncased.txt), | ||
or in your terminal run: | ||
```shell | ||
curl https://storage.googleapis.com/tensorflow/keras-nlp/examples/bert/bert_vocab_uncased.txt \ |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
same here curl -O url
to keep this a one liner.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I am doing a renaming here - in the README we are mixing vocab.txt with bert_vocab_uncased.txt, so to unify them I am only keeping vocab.txt at every reference.
|
||
```shell | ||
python3 examples/bert/run_glue_finetuning.py \ | ||
--saved_model_input path/to/model/ \ |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can probably just leave this as is?
We don't really need to the output model from fine-tuning to be saved anywhere usually. Really what we would want is to save some predictions in the GLUE submission format (tracked here #115).
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yea, I feel that users may find the need to reevaluate the model? If we do not save the model then people won't have access to the finetuned model except finetuning again.
806eafc
to
ae9d0a2
Compare
examples/bert/README.md
Outdated
|
||
```shell | ||
curl https://dumps.wikimedia.org/enwiki/latest/enwiki-latest-pages-articles.xml.bz2 | ||
curl -O https://dumps.wikimedia.org/enwiki/latest/enwiki-latest-pages-articles.xml.bz2 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
looks like trailing space here.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
good catch!
08379fc
to
d836c28
Compare