Some Faroese language statistics taken from fo.wikipedia.org content dump
(Ongoing module in development) Getting Wikipedia articles parsed content. Created for getting text corpuses data fast and easy. But can be freely used for other purpuses too
Clustering of Spanish Wikipedia articles.
A search engine trained from a corpus of wikipedia articles to provide efficient query results.
A Search Engine built based on Wikipedia dump of 75GB. Involves creation of Index file and returns search results in real time
Create a wiki corpus using a wiki dump file for Natural Language Processing
Python script to split the text generated by 'wikipedia parallel title extractor' into separate text files (separate file for each language)
Command line tool to extract plain text from Wikipedia database dumps
Distributed representations of words and named entities trained on Wikipedia. | Updated to gensim 4.
Convert WIKI dumped XML (Chinese) to human readable documents in markdown and txt.
Collects a multimodal dataset of Wikipedia articles and their images
A complete Python text analytics package that allows users to search for a Wikipedia article, scrape it, conduct basic text analytics and integrate it to a data pipeline without writing excessive code.
Python package for working with MediaWiki XML content dumps
Involves building a search engine on the Wikipedia Data Dump using the data dump of 2013 of size 43 GB. The search results returns in real time.
Wikipedia text corpus for self-supervised NLP model training
Corpus creator for Chinese Wikipedia
Add a description, image, and links to the wikipedia-corpus topic page so that developers can more easily learn about it.
To associate your repository with the wikipedia-corpus topic, visit your repo's landing page and select "manage topics."