XTREME-R Availability

[sumanthd17]

Hi Guys,

Great work extending the XTREME benchmark to much harder XTREME-R. I wanted to understand the availability of the benchmarks and the leaderboard. In particular I'm looking at Mewsli-X availability, I was able to fetch others datasets from sources mentioned in the paper.

Thanks

[sebastianruder]

Hi @sumanthd17, thanks for checking in. We're planning to finish integrating XTREME-R into this repo and to make it easy to download, train, and evaluate on the tasks over the next couple of weeks. So expect to see more XTREME-R related changes trickling in. Thanks for your patience.

[sumanthd17]

Thanks @sebastianruder, that's very helpful

[melvinjosej]

Thanks for interest @sumanthd17. We're working on making this available soon. Closing this thread for now.

[kabirahuja2431]

Checking to see if there are any updates on the availability of XTREME-R. Thanks!

[sebastianruder]

Sorry about the delay, @kabirahuja2431. Recent conference deadlines have pushed the release a bit further back. We're working on releasing this soon.

[gowtham1997]

Hey guys,
Any updates on the availability of this release? It would really help us test/evaluate models on the newly included tasks.
Thanks

[sebastianruder]

We're working on it. Sorry about the delay. :-/