Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Functions to processing/cleaning wikipedia dump #32

Closed
dselivanov opened this issue Oct 22, 2015 · 4 comments
Closed

Functions to processing/cleaning wikipedia dump #32

dselivanov opened this issue Oct 22, 2015 · 4 comments

Comments

@dselivanov
Copy link
Owner

@dselivanov dselivanov commented Oct 22, 2015

We need something like gensim's wikicorpus.py and make_wikicorpus.py for cleaning wikipedia markup in R.

This is really useful feature for future experiments.
Contributions are very welcome - believe it will be not too hard to implement something similar in R using efficient stringi library.

@saraswatmks
Copy link

@saraswatmks saraswatmks commented Aug 23, 2018

Hi @dselivanov I just bumped into this, is this still to be done?

@dselivanov
Copy link
Owner Author

@dselivanov dselivanov commented Aug 25, 2018

@saraswatmks
Copy link

@saraswatmks saraswatmks commented Aug 28, 2018

Okay nice. I will work on it and soon make a PR. cool ?

@dselivanov
Copy link
Owner Author

@dselivanov dselivanov commented Aug 29, 2018

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
2 participants
You can’t perform that action at this time.