-
Notifications
You must be signed in to change notification settings - Fork 538
Conversation
Please help to resolve this issue: #56 |
Job PR-55/4 is complete. |
|
||
Use the following command to run the AWDRNN language model setting | ||
All the language models are trained with this script: :download:`this example script <word_language_model.py>`. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Link is broken. <language_model/word_language_model.py>
|
||
|
||
+----------------+-----------------------------+----------------------------+----------------------------------+---------------------------------+-------------------------------+ | ||
| Model | awd_lstm_lm_1150_wikitext-2 | awd_lstm_lm_600_wikitext-2 | standard_lstm_lm_1500_wikitext-2 | standard_lstm_lm_650_wikitext-2 | standard_lstm_lm_200_wikitext | | ssd_512_vgg16_atrous_voc | |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This table didn't render properly. http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR-55/4/scripts/index.html#word-language-model
|
||
.. code-block:: bash | ||
|
||
$ python word_language_model.py --gpus 0 --tied --save awd_lstm_lm_1150_wikitext-2 # Val PPL 73.32 Test PPL 69.74 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
You can put the performance along with [1] awd_lstm_lm_1150_wikitext-2
, such as [1] awd_lstm_lm_1150_wikitext-2 (Val PPL 73.32 Test PPL 69.74):
be7aad2
to
e3c991c
Compare
Job PR-55/5 is complete. |
|
||
Use the following command to run the AWDRNN language model setting (emsize=400, nhid=1,150) | ||
Merity, S., et al. "`Regularizing and optimizing LSTM language models <https://openreview.net/pdf?id=SyyGPP0TZ>`_". ICLR 2018 | ||
---------------------------------------------------------------------------------------------------------- |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
use ~~~~~~~
Job PR-55/7 is complete. |
* update model description with reference to paper, add table and numbers to clarity * update table * update table * update rst
Description
Checklist
Essentials
Changes
Comments