| Metric | Score |
|---|---|
| Exact Match | 30.2% |
| F1 | 48.2% |
| SBERT | 67.1% |
| ROUGE-L | 49.0% |
| Category | Questions | Exact Match | F1 |
|---|---|---|---|
| Factual | 32 | 0% | 24% |
| Temporal | 37 | 14% | 43% |
| Hypothetical | 13 | 0% | 15% |
| General | 70 | 20% | 42% |
| Adversarial | 47 | 87% | 87% |
manavnotop/simplemem
Folders and files
| Name | Name | Last commit date | ||
|---|---|---|---|---|