Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[twitch.tv] Excessive JSON page downloads #8740

Closed
buchno opened this issue Mar 3, 2016 · 0 comments
Closed

[twitch.tv] Excessive JSON page downloads #8740

buchno opened this issue Mar 3, 2016 · 0 comments
Labels

Comments

@buchno
Copy link

@buchno buchno commented Mar 3, 2016

Trying to download a Twitch channel's past broadcasts results in an indefinite amount of JSON page downloads.

$ youtube-dl -v http://www.twitch.tv/arumba07/profile/past_broadcasts
[debug] System config: []
[debug] User config: []
[debug] Command-line args: ['-v', 'http://www.twitch.tv/arumba07/profile/past_broadcasts']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2016.03.01
[debug] Python version 3.5.1 - Linux-4.4.1-2-ARCH-x86_64-with-arch
[debug] exe versions: ffmpeg 3.0, ffprobe 3.0, rtmpdump 2.4
[debug] Proxy map: {}
[twitch:past_broadcasts] arumba07: Downloading channel info JSON
[twitch:past_broadcasts] arumba07: Downloading past broadcasts videos JSON page 1
[twitch:past_broadcasts] arumba07: Downloading past broadcasts videos JSON page 2
[twitch:past_broadcasts] arumba07: Downloading past broadcasts videos JSON page 3
[twitch:past_broadcasts] arumba07: Downloading past broadcasts videos JSON page 4
...
[twitch:past_broadcasts] arumba07: Downloading past broadcasts videos JSON page 839
[twitch:past_broadcasts] arumba07: Downloading past broadcasts videos JSON page 840
[twitch:past_broadcasts] arumba07: Downloading past broadcasts videos JSON page 841
[twitch:past_broadcasts] arumba07: Downloading past broadcasts videos JSON page 842
^C
ERROR: Interrupted by user

The channel in the log has at the time of writing 14 past broadcasts. I have tried letting it sit over night, resulting in over 20000 pages without finishing. Before this issue arose, such a channel would require about 2 JSON page downloads before getting all the information required to download the individual past broadcasts.

@yan12125 yan12125 added the broken-IE label Mar 3, 2016
@dstftw dstftw closed this in 539a164 Mar 3, 2016
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
2 participants
You can’t perform that action at this time.