Distance Memory Recurrent Networks, an memory network like learning scheme Results Comparison Thus far
| Task Number/Name | LSTM | MemNN-1 | MemNN-2 | MemNN-3 | DMRNN-1 | DMRNN-2 | DMRNN-3 |
|---|---|---|---|---|---|---|---|
| QA1 - Single Supporting Fact | 0.5 | 0.992 | 1 | 1 | 1 | 1 | 1 |
| QA2 - Two Supporting Facts | 0.2 | 0.38 | 0.844 | 0.886 | 0.362 | 0.812 | 0.966 |
| QA3 - Three Supporting Facts | 0.2 | 0.231 | 0.684 | 0.781 | 0.346 | 0.707 | 0.748 |
| QA4 - Two Arg. Relations | 0.61 | 0.772 | 0.978 | 0.866 | 0.891 | 0.885 | 0.891 |
| QA5 - Three Arg. Relations | 0.7 | 0.89 | 0.866 | 0.856 | 0.847 | 0.838 | 0.834 |
| QA6 - Yes/No Questions | 0.48 | 0.928 | 0.977 | 0.972 | 0.999 | 1 | 1 |
| QA7 - Counting | 0.49 | 0.841 | 0.746 | 0.817 | 0.881 | 0.767 | 0.862 |
| QA8 - Lists/Sets | 0.45 | 0.868 | 0.883 | 0.907 | 0.95 | 0.969 | 0.965 |
| QA9 - Simple Negation | 0.64 | 0.949 | 0.98 | 0.981 | 1 | 1 | 1 |
| QA10 - Indefinite Knowledge | 0.44 | 0.894 | 0.95 | 0.935 | 0.997 | 0.999 | 0.999 |
| QA11 - Basic Coreference | 0.62 | 0.916 | 0.988 | 0.997 | 0.926 | 0.928 | 0.955 |
| QA12 - Conjunction | 0.74 | 0.996 | 1 | 0.999 | 1 | 1 | 1 |
| QA13 - Compound Coreference | 0.94 | 0.937 | 0.998 | 0.998 | 0.946 | 0.954 | 0.969 |
| QA14 - Time Reasoning | 0.27 | 0.631 | 0.919 | 0.931 | 0.784 | 1 | 1 |
| QA15 - Basic Deduction | 0.21 | 0.536 | 0.995 | 1 | 0.839 | 1 | 1 |
| QA16 - Basic Induction | 0.23 | 0.526 | 0.487 | 0.973 | 0.467 | 0.457 | 0.457 |
| QA17 - Positional Reasoning | 0.51 | 0.556 | 0.588 | 0.596 | 0.56 | 0.522 | 0.544 |
| QA18 - Size Reasoning | 0.52 | 0.904 | 0.897 | 0.906 | 0.914 | 0.907 | 0.913 |
| QA19 - Path Finding | 0.08 | 0.093 | 0.101 | 0.12 | 0.133 | 0.109 | 0.141 |
| QA20 - Agent’s Motivations | 0.91 | 1 | 0.999 | 1 | 1 | 1 | 1 |
| Overall Mean | 0.487 | 0.742 | 0.844 | 0.87605 | 0.7921 | 0.8427 | 0.8622 |
| 0.95 Threshold | 0 | 3 | 9 | 9 | 6 | 10 | 12 |