Skip to content

More efficient Wikia download and launcher.py#378

Merged
nemobis merged 3 commits intoWikiTeam:masterfrom
nemobis:wikia
Mar 7, 2020
Merged

More efficient Wikia download and launcher.py#378
nemobis merged 3 commits intoWikiTeam:masterfrom
nemobis:wikia

Conversation

@nemobis
Copy link
Copy Markdown
Member

@nemobis nemobis commented Mar 7, 2020

The last patches used to complete the Wikia dump of February 2020:
https://archive.org/download/wikia_dump_20200214

For instance, do not skip gleefandomcom if gleefandomcom_ru is found.
No idea if "python2" will be converted to anything meaningful on Windows,
but then you're not really supposed to use the shell either in that dungeon.
https://docs.python.org/2.7/library/subprocess.html#subprocess.Popen
* Make it easy to batch requests for some wikis where millions of titles
  are really just one-revision thread items and need to be gone through
  as fast as possible.
* Status code error message.
@nemobis nemobis merged commit 6e85afc into WikiTeam:master Mar 7, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant