Request rate limits

[vasi]

Another minor issue with the Justin.tv/Twitch.tv support. It seems the Justin.tv API has a rate limit, but it's not limited to a certain bandwidth, rather to a certain number of requests.

This creates a problem with huge channels. Eg, if I add a line to print the requested URLs:

$ youtube-dl -v http://www.twitch.tv/manvsgame
http://api.justin.tv/channel/archives/manvsgame.json?offset=0&limit=100
http://api.justin.tv/channel/archives/manvsgame.json?offset=100&limit=100
[snip]
http://api.justin.tv/channel/archives/manvsgame.json?offset=1600&limit=100
http://api.justin.tv/channel/archives/manvsgame.json?offset=1700&limit=100
ERROR: unable to download video info JSON: HTTP Error 400: Bad Request

Here's a simple sort-of-fix, that at least allows youtube-dl's --ignore-errors option to work: https://github.com/vasi/youtube-dl/compare/justintv-ratelimit . Ideally though, there should be some functionality within youtube-dl to allow limiting the request rate.