Code for ruSciBench benchmark

Code to use the ruSciBench benchmark: takes embeddings of texts from the benchmark dataset as input, returns metrics values. Code partially based on SciDocs.

Habr post

Benchmark text data

Google Colab example

Authors

Benchmark developed by MLSA Lab of Institute for AI, MSU.

Acknowledgement

The research is part of the project #23-Ш05-21 SES MSU "Development of mathematical methods of machine learning for processing large-volume textual scientific information". We would like to thank eLibrary for provided datasets.

Contacts

Nikolai Gerasimenko (nikgerasimenko@gmail.com), Alexey Vatolin (vatolinalex@gmail.com)