Functions to processing/cleaning wikipedia dump

[dselivanov]

We need something like gensim's wikicorpus.py and make_wikicorpus.py for cleaning wikipedia markup in R.

This is really useful feature for future experiments.
Contributions are very welcome - believe it will be not too hard to implement something similar in R using efficient stringi library.

[saraswatmks]

Hi @dselivanov I just bumped into this, is this still to be done?

[dselivanov]

Yes чт, 23 авг. 2018 г., 18:18 Manish Saraswat <notifications@github.com>:

…

Hi @dselivanov <https://github.com/dselivanov> I just bumped into this, is this still to be done? — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#32 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AE4u3boqm0hnfYrr-m7NIV7S6afNfMRZks5uTo-DgaJpZM4GT2ib> .

[saraswatmks]

Okay nice. I will work on it and soon make a PR. cool ?

[dselivanov]

Cool, thanks. I'm off the connection till ~ Sep 10. вт, 28 авг. 2018 г., 23:43 Manish Saraswat <notifications@github.com>:

…

Okay nice. I will work on it and soon make a PR. cool ? — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#32 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AE4u3clE-QWG32UaYr9s7-f72kXNiNqaks5uVXM9gaJpZM4GT2ib> .