Permalink
Find file
Fetching contributors…
Cannot retrieve contributors at this time
16 lines (10 sloc) 328 Bytes
Grab all Wikipedia abstracts, in all languages
For every dump in:
http://dumps.wikimedia.org/backup-index.html
find the file abstract.xml and wget it.
USAGE:
./grab-wikipedia-abstracts.py
This will create a directory download.wikimedia.org/ with the abstract.xml files.
REQUIREMENTS:
* BeautifulSoup
* wget