Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Scripts hangs during retrieval of images (from Tumblr) #36

Closed
SylvainDe opened this issue May 26, 2016 · 6 comments
Closed

Scripts hangs during retrieval of images (from Tumblr) #36

SylvainDe opened this issue May 26, 2016 · 6 comments

Comments

@SylvainDe
Copy link
Owner

No description provided.

SylvainDe added a commit that referenced this issue May 27, 2016
To make analysis of #36 easier
@SylvainDe
Copy link
Owner Author

SylvainDe commented May 27, 2016

  File "comicbookmaker.py", line 88, in <module>
    main()
  File "comicbookmaker.py", line 63, in main
    com.update()
  File "path/ComicBookMaker/comic_abstract.py", line 189, in update
    for i in comic['img']]
  File "path/ComicBookMaker/comic_abstract.py", line 189, in <listcomp>
    for i in comic['img']]
  File "path/ComicBookMaker/comic_abstract.py", line 81, in get_file_in_output_dir
    return get_file_at_url(url, filename)
  File "path/ComicBookMaker/urlfunctions.py", line 104, in get_file_at_url
    shutil.copyfileobj(response, out_file)
  File "path/ComicBookMaker/my_env/lib/python3.4/shutil.py", line 67, in copyfileobj
    buf = fsrc.read(length)
  File "/usr/lib/python3.4/http/client.py", line 500, in read
    return super(HTTPResponse, self).read(amt)
  File "/usr/lib/python3.4/http/client.py", line 539, in readinto
    n = self.fp.readinto(b)
  File "/usr/lib/python3.4/socket.py", line 374, in readinto
    return self._sock.recv_into(b)

@SylvainDe
Copy link
Owner Author

respawn-tumblr : about to update
get_content (url : http://respawncomic.tumblr.com/api/read/?id=144396628892)
urlopen_wrapper (url : http://respawncomic.tumblr.com/api/read/?id=144396628892)
get_content (url : http://respawncomic.tumblr.com/api/read/)
urlopen_wrapper (url : http://respawncomic.tumblr.com/api/read/)
get_content (url : http://respawncomic.tumblr.com/api/read/?start=0&num=10)
urlopen_wrapper (url : http://respawncomic.tumblr.com/api/read/?start=0&num=10)
get_file_at_url (url : http://67.media.tumblr.com/ac8bf40312b6e14aa99111f1ccd164c6/tumblr_o7k6imiRpu1uox9ngo1_1280.jpg, path : respawn-tumblr/tumblr_o7k6imiRpu1uox9ngo1_1280.jpg)
urlopen_wrapper (url : http://67.media.tumblr.com/ac8bf40312b6e14aa99111f1ccd164c6/tumblr_o7k6imiRpu1uox9ngo1_1280.jpg)

Retrieving the file at http://67.media.tumblr.com/ac8bf40312b6e14aa99111f1ccd164c6/tumblr_o7k6imiRpu1uox9ngo1_1280.jpg takes forever for some reason.
When getting it from my browser (on a different machine), it works instantly.
A wget from a different machine works instantly.
A wget from the same machine takes forever.

I guess I've been banned or something.

SylvainDe added a commit that referenced this issue May 27, 2016
SylvainDe added a commit that referenced this issue Jun 14, 2016
SylvainDe added a commit that referenced this issue Jun 17, 2016
SylvainDe added a commit that referenced this issue Jun 19, 2016
SylvainDe added a commit that referenced this issue Jul 1, 2016
Issue #36 seems to be fixed but I have
no explanation.
@SylvainDe
Copy link
Owner Author

Close for the time being as everything seems fine but I have no explanation.

SylvainDe added a commit that referenced this issue Jul 21, 2016
Unfortunately, it seems to suffer from #36 .
SylvainDe added a commit that referenced this issue Jul 21, 2016
Unfortunately, it seems to suffer from #36 .
SylvainDe added a commit that referenced this issue Jul 23, 2016
Unfortunately, it seems to suffer from #36 .
@SylvainDe SylvainDe reopened this Jul 30, 2016
SylvainDe added a commit that referenced this issue Jul 30, 2016
@SylvainDe
Copy link
Owner Author

Error reported to https://www.tumblr.com/support

I use a script to retrieve images from Tumblr blogs using the Tumblr V1 API. Sometimes, the retrieval of a particular image from its URL just hangs and never ends. I saw this issue during May and beginning of July, I had the issue that everything was working just fine but ~2 weeks ago, things started to fail again. The images involves are always the same : it is fails once, it will always fail. The issue is limited to a machine and does not seem to depend of the data in the HTTP request. I am expecting some kind of blacklist of some sort but I do not have much information about this and if it is a bug, I'd like you to know about it.

For instance, the following image: http://67.media.tumblr.com/d9dea3f90dfe35948a27fde23345cf70/tumblr_nm9512sxxB1tcbp8vo9_1280.jpg cannot be retrieved as one can see running the following command: "wget http://67.media.tumblr.com/d9dea3f90dfe35948a27fde23345cf70/tumblr_nm9512sxxB1tcbp8vo9_1280.jpg"

It runs forever from the machine with the error but works fine on a different machine behind a different IP.

Please let me know if there is anything I am not doing properly and I'll be happy to comply.

Thanks.

SylvainDe added a commit that referenced this issue Aug 20, 2016
SylvainDe added a commit that referenced this issue Aug 20, 2016
Unfortunately most of them suffer from #36 .
SylvainDe added a commit that referenced this issue Aug 21, 2016
SylvainDe added a commit that referenced this issue Aug 29, 2016
SylvainDe added a commit that referenced this issue Sep 22, 2016
SylvainDe added a commit that referenced this issue Oct 1, 2016
SylvainDe added a commit that referenced this issue Oct 16, 2016
SylvainDe added a commit that referenced this issue Oct 26, 2016
Also fix typo in short name
SylvainDe added a commit that referenced this issue Oct 26, 2016
@SylvainDe
Copy link
Owner Author

This issue seems to be fixed on the Tumblr side now. I'll see if all comics can be reactivated :)

SylvainDe added a commit that referenced this issue Dec 9, 2016
Issue 36 seems to be fixed on the Tumblr side
so (most) comics can be reactivated and there
is not real need for a `GenericTumblrV1Empty`
class anymore.
@SylvainDe
Copy link
Owner Author

The issue is fixed by Tumblr.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant