Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tatoeba baseline from XTREME-R #97

Open
pefimov opened this issue Oct 14, 2022 · 0 comments
Open

Tatoeba baseline from XTREME-R #97

pefimov opened this issue Oct 14, 2022 · 0 comments

Comments

@pefimov
Copy link

pefimov commented Oct 14, 2022

It is not clear which model is used for Tatoeba task.

XTREME-R paper says:

To make the setting more realistic, we move away from zero-shot retrieval and fine-tune models on SQuAD v1.1.

Script run_tatoeba.sh says:
# Add fine-tuned model path here
MODEL=/mnt/disk-1/models/squad/xlm-roberta-large_LR3e-5_EPOCH2.0_maxlen384_batchsize2_gradacc16

Does it mean that authors use model fine-tuned on original SQuAD for MRC task? Or it is something similar to LAReQA baseline?

@pefimov pefimov changed the title Tatoeba baseline Tatoeba baseline from XTREME-R paper Oct 14, 2022
@pefimov pefimov changed the title Tatoeba baseline from XTREME-R paper Tatoeba baseline from XTREME-R Oct 14, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant