Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error "The allpages API returned nothing" on gamepedia.com HTTP URL #334

Closed
Thyphoon05 opened this issue Jan 25, 2019 · 2 comments · Fixed by #346
Closed

Error "The allpages API returned nothing" on gamepedia.com HTTP URL #334

Thyphoon05 opened this issue Jan 25, 2019 · 2 comments · Fixed by #346
Labels

Comments

@Thyphoon05
Copy link

Thyphoon05 commented Jan 25, 2019

I tried to dump this wiki: https://lifeisfeudal.gamepedia.com

and dumpgenerator.py fail retrieving titles in the namespace 0.

D:\wikiteam-master>python dumpgenerator.py --api=https://lifeisfeudal.gamepedia.com/api.php --xml --curonly --images

Checking API... https://lifeisfeudal.gamepedia.com/api.php
API is OK: https://lifeisfeudal.gamepedia.com/api.php
Checking index.php... https://lifeisfeudal.gamepedia.com/index.php
index.php is OK

Analysing https://lifeisfeudal.gamepedia.com/api.php

Trying generating a new dump into a new directory...
Loading page titles from namespaces = all
Excluding titles from namespaces = None
21 namespaces found
Retrieving titles in the namespace 0
..The allpages API returned nothing. Exit.

@nemobis
Copy link
Member

nemobis commented Feb 7, 2020

Works for me on current master. The allpages API should be working: https://lifeisfeudal.gamepedia.com/api.php?action=query&list=allpages&apfrom=B

Trying generating a new dump into a new directory...
Loading page titles from namespaces = all
Excluding titles from namespaces = None
23 namespaces found
    Retrieving titles in the namespace 0
.....    2397 titles retrieved in the namespace 0
    Retrieving titles in the namespace 1
.    69 titles retrieved in the namespace 1
    Retrieving titles in the namespace 2
.    25 titles retrieved in the namespace 2
    Retrieving titles in the namespace 3
.    31 titles retrieved in the namespace 3
    Retrieving titles in the namespace 4
.    24 titles retrieved in the namespace 4
    Retrieving titles in the namespace 5
.    2 titles retrieved in the namespace 5
    Retrieving titles in the namespace 6
......    2808 titles retrieved in the namespace 6
    Retrieving titles in the namespace 7
.    2 titles retrieved in the namespace 7
    Retrieving titles in the namespace 8
.    25 titles retrieved in the namespace 8
    Retrieving titles in the namespace 9
.    0 titles retrieved in the namespace 9
    Retrieving titles in the namespace 10
.    141 titles retrieved in the namespace 10
    Retrieving titles in the namespace 11
.    1 titles retrieved in the namespace 11
    Retrieving titles in the namespace 12
.    8 titles retrieved in the namespace 12
    Retrieving titles in the namespace 13
.    0 titles retrieved in the namespace 13
    Retrieving titles in the namespace 14
..    510 titles retrieved in the namespace 14
    Retrieving titles in the namespace 15
.    0 titles retrieved in the namespace 15
    Retrieving titles in the namespace 10000
.    1 titles retrieved in the namespace 10000
    Retrieving titles in the namespace 10001
.    0 titles retrieved in the namespace 10001
    Retrieving titles in the namespace 274
.    1 titles retrieved in the namespace 274
    Retrieving titles in the namespace 275
.    0 titles retrieved in the namespace 275
    Retrieving titles in the namespace 828
.    11 titles retrieved in the namespace 828
    Retrieving titles in the namespace 829
.    0 titles retrieved in the namespace 829
    Retrieving titles in the namespace 202
.    0 titles retrieved in the namespace 202

However, if it doesn't, try --xmlrevisions. I just made a dump for this wiki that way.

@nemobis
Copy link
Member

nemobis commented Feb 7, 2020

Actually, nevermind, I was able to reproduce the error while testing the python 3 branch. It's because of the POST, which usually helps avoid some barriers but here does the opposite. We can switch to get.

@nemobis nemobis reopened this Feb 7, 2020
@nemobis nemobis changed the title Cant dump wiki from gamepedia.com Error "The allpages API returned nothing" on gamepedia.com Feb 7, 2020
nemobis added a commit to nemobis/wikiteam that referenced this issue Feb 7, 2020
POST does not follow the redirect from HTTP to HTTPS, which makes the
request (and the entire dump) fail if an API URL is passed like
http://7daystodie-de.gamepedia.com/api.php

Fixes WikiTeam#334
@nemobis nemobis changed the title Error "The allpages API returned nothing" on gamepedia.com Error "The allpages API returned nothing" on gamepedia.com HTTP URL Feb 7, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants