Skip to content
This repository has been archived by the owner on Nov 25, 2019. It is now read-only.

Compilation of german Wikipedia failed #4

Closed
itkach opened this issue Oct 27, 2010 · 4 comments
Closed

Compilation of german Wikipedia failed #4

itkach opened this issue Oct 27, 2010 · 4 comments

Comments

@itkach
Copy link
Member

itkach commented Oct 27, 2010

(Originally reported by anonymous on Apr 24, 2009 at BitBucket)

aardc wiki dewiki-20090311-pages-articles.xml.bz2 -t dewiki-20090311-pages-articles.cdb

INFO: Maximum file size is 4294967295 bytes
INFO: Creating temp dir ./aardc-article-db-40eM6K
INFO: Collecting articles
INFO: Collecting articles in dewiki-20090311-pages-articles.xml.bz2
sh: texvc: not found
sh: blahtexml: not found
INFO: Creating new worker pool
INFO: Language: de
98INFO: Special article Wikipedia:Aktuelles, skipping (1 so far)

### skipping thousands of lines

647831INFO: Special article Datei:Poleck.JPG, skipping (294585 so far)
    Traceback (most recent call last):
    File "/usr/bin/aardc", line 8, in <module>
    load_entry_point('aardtools==0.7.2.dev', 'console_scripts', 'aardc')()
    File "build/bdist.linux-i686/egg/aardtools/compiler.py", line 659, in main
    File "build/bdist.linux-i686/egg/aardtools/compiler.py", line 485, in compile_wiki
    File "build/bdist.linux-i686/egg/aardtools/wiki.py", line 230, in parse_mp
    File "/usr/lib/python2.5/site-packages/multiprocessing-2.6.1.1-py2.5-linux-i686.egg/multiprocessing/pool.py", line 520, in next
    raise value
EnvironmentError: [Errno 12] **Cannot allocate memory**
@itkach
Copy link
Member Author

itkach commented Oct 27, 2010

(Commented by anonymous on Apr 25, 2009 at BitBucket)

Can you try with mwlib 0.9.12 (and uninstall blist)?

@itkach
Copy link
Member Author

itkach commented Oct 27, 2010

(Commented by b68 on Apr 29, 2009 at BitBucket)

Removed blist and downgrade mwlib to 0.9.12. -> same error

mw-buildcdb creates an idendical output with mwlib version 0.9.12, 0.9.13 and
0.10.4.

'aardc --nomp' ends with an other error after a few seconds. output is
attached (nomp.txt)

@itkach
Copy link
Member Author

itkach commented Oct 27, 2010

(Commented by b68 on May 28, 2009 at BitBucket)

update aardtools to version 0.7.3 solved this issue.

thx for fix this problem

@itkach
Copy link
Member Author

itkach commented Oct 27, 2010

(Commented by itkach on May 28, 2009 at BitBucket)

Thank you for verifying this.

This issue was closed.
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant