Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] [new change of site] some link src of big mode are unable to download #60

Closed
sabearcher opened this issue Dec 11, 2014 · 7 comments
Labels

Comments

@sabearcher
Copy link

pixiv site changed link of big mode.
there's an example: big mode is not a link "http://www.pixiv.net/member_illust.php?mode=big&illust_id=47503045" but a lable, please see below.

----- console info ---------------------
Input: 2
Image ids: 47503045
Processing Image Id: 47503045
send: 'GET /member_illust.php?mode=medium&illust_id=47503045 HTTP/1.1\r\nAccept-
Encoding: identity\r\nReferer: http://www.pixiv.net\r\nHost: www.pixiv.net\r\nCo
okie: module_orders_mypage=%5B%7B%22name%22%3A%22everyone_new_illusts%22%2C%22vi
sible%22%3Atrue%7D%2C%7B%22name%22%3A%22spotlight%22%2C%22visible%22%3Atrue%7D%2
C%7B%22name%22%3A%22featured_tags%22%2C%22visible%22%3Atrue%7D%2C%7B%22name%22%3
A%22contests%22%2C%22visible%22%3Atrue%7D%2C%7B%22name%22%3A%22following_new_ill
usts%22%2C%22visible%22%3Atrue%7D%2C%7B%22name%22%3A%22mypixiv_new_illusts%22%2C
%22visible%22%3Atrue%7D%2C%7B%22name%22%3A%22booth_follow_items%22%2C%22visible%
22%3Atrue%7D%5D; p_ab_id=2; PHPSESSID=5021835_620eb5ddaa84fa19e0e2049b06145141\r
\nConnection: close\r\nUser-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebK
it/537.36 (KHTML, like Gecko) Chrome/37.0.2062.124 Safari/537.36\r\n\r\n'
reply: 'HTTP/1.1 200 OK\r\n'
header: Server: nginx
header: Date: Thu, 11 Dec 2014 13:35:26 GMT
header: Content-Type: text/html; charset=UTF-8
header: Transfer-Encoding: chunked
header: Connection: close
header: Vary: Accept-Encoding
header: X-Host-Time: 158
header: Expires: Thu, 19 Nov 1981 08:52:00 GMT
header: Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-ch
eck=0
header: Pragma: no-cache
header: X-Frame-Options: SAMEORIGIN
Traceback (most recent call last):
File "PixivUtil2.py", line 608, in process_image
File "PixivModel.pyc", line 224, in init
File "PixivModel.pyc", line 287, in ParseInfo
UnboundLocalError: local variable 'temp' referenced before assignment
Error at process_image(): (<type 'exceptions.UnboundLocalError'>, UnboundLocalEr
ror("local variable 'temp' referenced before assignment",), <traceback object at
0x033FEEE0>)
Traceback (most recent call last):
File "PixivUtil2.py", line 1792, in main
File "PixivUtil2.py", line 1590, in main_loop
File "PixivUtil2.py", line 1329, in menu_download_by_image_id
File "PixivUtil2.py", line 608, in process_image
File "PixivModel.pyc", line 224, in init
File "PixivModel.pyc", line 287, in ParseInfo
UnboundLocalError: local variable 'temp' referenced before assignment
press enter to exit.

----- site html ------------------------
<div class="works_display">
<div class="_illust_modal _layout-big">
<img class="medium" alt="艦これイラスト集" src="http://i2.pixiv.net/c/600x600/img-master/img/2014/12/11/12/36/53/47503045_p0_master1200.jpg">
<img class="big" width="714" height="1000" alt="艦これイラスト集" data-src="http://i2.pixiv.net/img-original/img/2014/12/11/12/36/53/47503045_p0.jpg" src="http://i2.pixiv.net/img-original/img/2014/12/11/12/36/53/47503045_p0.jpg" style="">
</div>
</div>

@Nandaka
Copy link
Owner

Nandaka commented Dec 12, 2014

@sabearcher
Copy link
Author

Greate Wall forbid my link to the address, maybe I should try to pack it myself.

I already run it and had a test, bug is fixed. But, could you give me a guide of HOW TO PACK EXE ?

Nandaka added a commit that referenced this issue Dec 12, 2014
- Fix Issue #60: Update image parser to handle old and new layout.
- Fix html dump logic.
@sabearcher
Copy link
Author

@Nandaka
Just now, I run the commands successively, (I've copied Python27 to this directory)
---C:\TDDownload\PixivUtil2-master\python.exe setup.py build
---C:\TDDownload\PixivUtil2-master\python.exe setup.py clean
---C:\TDDownload\PixivUtil2-master\python.exe setup.py install
---C:\TDDownload\PixivUtil2-master\python.exe setup.py sdist
---C:\TDDownload\PixivUtil2-master\python.exe setup.py bdist
---C:\TDDownload\PixivUtil2-master\python.exe setup.py py2exe

THAN, I got this

skipping byte-compilation of C:\TDDownload\PixivUtil2-master\lib\warnings.py to
warnings.pyc
skipping byte-compilation of C:\TDDownload\PixivUtil2-master\lib\weakref.py to w
eakref.pyc
skipping byte-compilation of C:\TDDownload\PixivUtil2-master\lib\zipfile.py to z
ipfile.pyc
*** copy extensions ***
*** copy dlls ***
copying C:\TDDownload\PixivUtil2-master\lib\site-packages\py2exe\run.exe -> C:\T
DDownload\PixivUtil2-master\dist\PixivUtil2.exe
The following modules appear to be missing
['_scproxy', 'chardet', 'cjkcodecs.aliases', 'iconv_codec', 'mechanize', 'win32e
vtlog', 'win32evtlogutil']

*** binary dependencies ***
Your executable(s) also depend on these dlls which are not included,
you may or may not need to distribute them.

Make sure you have the license if you distribute any of them, and
make sure you don't distribute files belonging to the operating system.

USER32.dll - C:\Windows\system32\USER32.dll
SHELL32.dll - C:\Windows\system32\SHELL32.dll
WSOCK32.dll - C:\Windows\system32\WSOCK32.dll
ADVAPI32.dll - C:\Windows\system32\ADVAPI32.dll
WS2_32.dll - C:\Windows\system32\WS2_32.dll
KERNEL32.dll - C:\Windows\system32\KERNEL32.dll


so I get to check the dlls and found there's nothing wrong with them. Would you please give me a solution ?

@Nandaka
Copy link
Owner

Nandaka commented Dec 12, 2014

The following modules appear to be missing

Make sure you have the required lib

@sabearcher
Copy link
Author

The following modules appear to be missing
['_scproxy', 'chardet', 'cjkcodecs.aliases', 'email.Utils', 'iconv_codec', 'win3
2evtlog', 'win32evtlogutil']


console debug message above .

So, how can I got these to install? I'm no familiar with these packages.

I've found files:
lib/BeautifulSoup.py
lib/mechanize/init.py and so on
lib/site-packages/socks.py
lib/site-packages/py2exe/...

@Nandaka
Copy link
Owner

Nandaka commented Dec 13, 2014

use pip to install those packages, see https://pip.pypa.io/en/latest/installing.html

@Nandaka
Copy link
Owner

Nandaka commented Dec 17, 2014

Updated in #63

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants