Mewsli-X scripts

[sumanthd17]

Hi Guys,

Is it possible to get training and evaluation scripts for mewsli-X dataset? We are trying to reproduce the baseline results from the XTREME-R paper (Table 4), it would helpful for us if you can share the scripts used for training the models.

Thanks

[melvinjosej]

Hi @sumanthd17,

cc: @sebastianruder

Sorry for the delay here. We're working on hard to release the scripts for all the XTREME-R tasks. We hope to have this ready by the end of this month.

-- Melvin

[shunyuzh]

Hi @sumanthd17,

cc: @sebastianruder

Sorry for the delay here. We're working on hard to release the scripts for all the XTREME-R tasks. We hope to have this ready by the end of this month.

-- Melvin

Hi,

We also want the new scripts to evaluate the newly added task in XTREME-R, especially mewsli-X dataset. Is it ready now?

Thanks in advance.

[sumanthd17]

Hi @melvinjosej,

Is there an update on the training and eval scripts for Mewsli-X?

Thanks,

[sumanthd17]

Hi @melvinjosej,

Is there an update on the training and eval scripts for Mewsli-X?

Thanks,

[sebastianruder]

Hi @sumanthd17, as mentioned in #83, we spotted some quality issues in the Mewsli-X data. We are just finalizing a fix and doing a more thorough review of the data, which has been taking longer than expected. We expect to be able to release the data soon, in about two weeks.

[sumanthd17]

Hi @sebastianruder, sorry for the repeated questions. Just wanted to have a quick check if there's any update on this.

Thanks

[sebastianruder]

Hi @sumanthd17, we are just finalizing the last pieces of the data creation pipeline. We'll be able to share the final data soon. We'll share training and evaluation scripts in a separate update.