Initial release
We publish the code for compressing Gensim FastText models and using their small versions.
We also publish 4 compressed versions of the ruscorpora_none_fasttextskipgram_300_2_2019 model from RusVectores.
| Model | RAM, mb | Similarity to the original | Intrinsic evaluation (relative to the original) |
|---|---|---|---|
| ft_freqprune_50K_5K_pq_100.bin | 13 | 92.7% | 89.9% |
| ft_freqprune_100K_20K_pq_100.bin | 28 | 96.1% | 96.6% |
| ft_freqprune_100K_20K_pq_300.bin | 51 | 98.2% | 97.9% |
| ft_freqprune_400K_100K_pq_300.bin | 180 | 99.7% | 99.9% |