Add missing LM SOTA result + # params + prev SOTA #195
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
For better comparison of results wrt params. Also normalizes layer qualification.
Fix cited paper for Graves et al and include their primary result; previously only baseline.
Add results for the paper, Adaptive Input Representations for Neural Language Modeling
* Add results for LM paper, Transformer-XL * Remove superfluous vbar and normalize header * Add missing authors to item * Make under-review mark more discrete
Add results for the paper, Adaptive Input Representations for Neural Language Modeling
… into sebastianruder-master
Extend LM results (sebastianruder#194)
Add SOTA "ensemble" model for PTB. Add number of params for PTB and WT2
Add second-in-line LM SOTA for a strict interpretation of competing results.
|
@sebastianruder - Not promising anything but would you object to any of these additions?
|
At some point, these tables were generated from yaml data. These data files do not appear to exist anymore.
|
These all sound great. Thanks for your efforts, @cwenner! For the word similarity and analogy datasets, let's add them under the text similarity page for now. 👍 |
|
@sebastianruder - Okay, thanks. What's the goal for completeness vs relevance of the lists? E.g. the more the better; prune all but top-1 or top-2 non-dominated results (eg for LM, params vs ppl); keep seminal for comparison? Btw this is an unmerged PR. |
|
Yep, ~ top-2 state-of-the-art results with seminal methods for comparison. |
|
Nice work! I'll merge this now. Feel free to submit any other changes in a new PR. |
|
I think that's easier - thanks! |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Add missing LM ensemble which is SOTA for PTB.
Add second-in-line LM SOTA for strict interpretation.
Add number of params for LM results.
(unsure why it lists commits that have already been merged)