Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

No longer able to extract higher quality flv videos for most crunchyroll shows #11749

Closed
a4840639 opened this issue Jan 17, 2017 · 4 comments
Closed

Comments

@a4840639
Copy link

@a4840639 a4840639 commented Jan 17, 2017

Please follow the guide below

  • You will be asked some questions and requested to provide some information, please read them carefully and answer honestly
  • Put an x into all the boxes [ ] relevant to your issue (like that [x])
  • Use Preview tab to see how your issue will actually look like

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2017.01.16. If it's not read this FAQ entry and update. Issues with outdated version will be rejected.

  • [ x] I've verified and I assure that I'm running youtube-dl 2017.01.16

Before submitting an issue make sure you have:

  • [ x] At least skimmed through README and most notably FAQ and BUGS sections
  • [ x] Searched the bugtracker for similar issues including closed ones

What is the purpose of your issue?

  • Bug report (encountered problems with youtube-dl)
  • Site support request (request for adding support for a new site)
  • Feature request (request for a new functionality)
  • Question
  • [ x] Other

youtube-dl used to able to extract flv encodes of virtually all crunchyroll shows. These flv shows are encoded using 2-pass with a bitrate of around 3000kbps. However, recently the videos youtube-dl extracts are mostly mp4s. These mp4s are encoded with crf as low as 24.6 which is honestly quite bad, and their bitrates are thus often way below 3000kbps despite much lower x264 settings.

I know it is probably an API change on Crunchyroll's side but flv encodes certainly still exist because HorribleSubs is still able to release them (you can tell the encoding from the file size).

A show in mp4 encoding, note how low the bitrate is:

youtube-dl -F http://www.crunchyroll.com/interviews-with-monster-girls/episode-1-takahashi-tetsuo-wants-an-interview-728567\?t\=0
[Crunchyroll] 728567: Downloading webpage
[Crunchyroll] 728567: Downloading media info for 360p
[Crunchyroll] 728567: Downloading m3u8 information
[Crunchyroll] 728567: Downloading media info for 480p
[Crunchyroll] 728567: Downloading m3u8 information
[Crunchyroll] 728567: Downloading media info for 720p
[Crunchyroll] 728567: Downloading m3u8 information
[Crunchyroll] 728567: Downloading media info for 1080p
[Crunchyroll] 728567: Downloading m3u8 information
[Crunchyroll] 728567: Downloading media info
[Crunchyroll] 728567: Downloading subtitles for English (US)
[Crunchyroll] 728567: Downloading subtitles for Español
[Crunchyroll] 728567: Downloading subtitles for Español (España)
[Crunchyroll] 728567: Downloading subtitles for Français (France)
[Crunchyroll] 728567: Downloading subtitles for Português (Brasil)
[Crunchyroll] 728567: Downloading subtitles for العربية
[Crunchyroll] 728567: Downloading subtitles for Italiano
[Crunchyroll] 728567: Downloading subtitles for Deutsch
[info] Available formats for 728567:
format code  extension  resolution note
hls-meta-0   mp4        multiple   Quality selection URL 
hls-meta-1   mp4        multiple   Quality selection URL 
hls-meta-2   mp4        multiple   Quality selection URL 
hls-meta-3   mp4        multiple   Quality selection URL 
hls-405-0    mp4        640x360     405k , avc1.4d401e, 23.98fps, mp4a.40.2
hls-405-1    mp4        640x360     405k , avc1.4d401e, 23.98fps, mp4a.40.2
hls-405-2    mp4        640x360     405k , avc1.4d401e, 23.98fps, mp4a.40.2
hls-576-0    mp4        848x480     576k , avc1.4d401e, 23.98fps, mp4a.40.2
hls-576-1    mp4        848x480     576k , avc1.4d401e, 23.98fps, mp4a.40.2
hls-576-2    mp4        848x480     576k , avc1.4d401e, 23.98fps, mp4a.40.2
hls-858-0    mp4        1280x720    858k , avc1.64001f, 23.98fps, mp4a.40.2
hls-858-1    mp4        1280x720    858k , avc1.64001f, 23.98fps, mp4a.40.2
hls-858-2    mp4        1280x720    858k , avc1.64001f, 23.98fps, mp4a.40.2
hls-1433-0   mp4        1920x1080  1433k , avc1.640028, 23.98fps, mp4a.40.2
hls-1433-1   mp4        1920x1080  1433k , avc1.640028, 23.98fps, mp4a.40.2
hls-1433-2   mp4        1920x1080  1433k , avc1.640028, 23.98fps, mp4a.40.2 (best)

A very rare example of a show which is still available in flv:

youtube-dl -F http://www.crunchyroll.com/idol-incidents/episode-2-girl-s-728235\?t\=0
[Crunchyroll] 728235: Downloading webpage
[Crunchyroll] 728235: Downloading media info for 360p
[Crunchyroll] 728235: Downloading media info for 480p
[Crunchyroll] 728235: Downloading media info for 720p
[Crunchyroll] 728235: Downloading media info for 1080p
[Crunchyroll] 728235: Downloading media info
[Crunchyroll] 728235: Downloading subtitles for English (US)
[Crunchyroll] 728235: Downloading subtitles for Español
[Crunchyroll] 728235: Downloading subtitles for Español (España)
[Crunchyroll] 728235: Downloading subtitles for Français (France)
[Crunchyroll] 728235: Downloading subtitles for Português (Brasil)
[Crunchyroll] 728235: Downloading subtitles for العربية
[Crunchyroll] 728235: Downloading subtitles for Italiano
[Crunchyroll] 728235: Downloading subtitles for Deutsch
[info] Available formats for 728235:
format code  extension  resolution note
360p         flv        656x368    
480p         flv        848x480    
720p         flv        1280x720   
1080p        flv        1920x1080  (best)
@dstftw
Copy link
Collaborator

@dstftw dstftw commented Jan 17, 2017

@dstftw dstftw closed this Jan 17, 2017
@a4840639
Copy link
Author

@a4840639 a4840639 commented Jan 17, 2017

No flv is served by Crunchyroll for http://www.crunchyroll.com/interviews-with-monster-girls/episode-1-takahashi-tetsuo-wants-an-interview-728567. Webplayer uses m3u8 as well.

Okay it may not necessarily a relationship with flv but the fact is there exists a higher quality stream somewhere from Crunchyroll and HorribleSubs is able to rip this higher quality stream while youtube-dl is no longer able to do this.

@Starsam80
Copy link
Contributor

@Starsam80 Starsam80 commented Jan 17, 2017

@a4840639 While this may not help, but from what I've seen, Crunchyroll only serves flv files for a week after it airs, then adds (or replaces it with) m3u8 files. If people get higher quality videos, its probably because they get it in that one week time span that it only has flv. For example, Episode 1 of Interviews With Monster Girls was aired January 7th, over a week ago, and I only get mp4. Episode 2 however, aired January 14th, and I get flv.

./dl -t http://www.crunchyroll.com/interviews-with-monster-girls/episode-1-takahashi-tetsuo-wants-an-interview-728567 -F
[Crunchyroll] 728567: Downloading webpage
[Crunchyroll] 728567: Downloading media info for 360p
[Crunchyroll] 728567: Downloading m3u8 information
[Crunchyroll] 728567: Downloading media info for 480p
[Crunchyroll] 728567: Downloading m3u8 information
[Crunchyroll] 728567: Downloading media info for 720p
[Crunchyroll] 728567: Downloading m3u8 information
[Crunchyroll] 728567: Downloading media info for 1080p
[Crunchyroll] 728567: Downloading m3u8 information
[Crunchyroll] 728567: Downloading media info
[Crunchyroll] 728567: Downloading subtitles for English (US)
[Crunchyroll] 728567: Downloading subtitles for Español
[Crunchyroll] 728567: Downloading subtitles for Español (España)
[Crunchyroll] 728567: Downloading subtitles for Français (France)
[Crunchyroll] 728567: Downloading subtitles for Português (Brasil)
[Crunchyroll] 728567: Downloading subtitles for العربية
[Crunchyroll] 728567: Downloading subtitles for Italiano
[Crunchyroll] 728567: Downloading subtitles for Deutsch
[info] Available formats for 728567:
format code  extension  resolution note
hls-meta-0   mp4        multiple   Quality selection URL
hls-meta-1   mp4        multiple   Quality selection URL
hls-meta-2   mp4        multiple   Quality selection URL
hls-meta-3   mp4        multiple   Quality selection URL
hls-405-0    mp4        640x360     405k , avc1.4d401e, 23.98fps, mp4a.40.2
hls-405-1    mp4        640x360     405k , avc1.4d401e, 23.98fps, mp4a.40.2
hls-405-2    mp4        640x360     405k , avc1.4d401e, 23.98fps, mp4a.40.2
hls-576-0    mp4        848x480     576k , avc1.4d401e, 23.98fps, mp4a.40.2
hls-576-1    mp4        848x480     576k , avc1.4d401e, 23.98fps, mp4a.40.2
hls-576-2    mp4        848x480     576k , avc1.4d401e, 23.98fps, mp4a.40.2
hls-858-0    mp4        1280x720    858k , avc1.64001f, 23.98fps, mp4a.40.2
hls-858-1    mp4        1280x720    858k , avc1.64001f, 23.98fps, mp4a.40.2
hls-858-2    mp4        1280x720    858k , avc1.64001f, 23.98fps, mp4a.40.2
hls-1433-0   mp4        1920x1080  1433k , avc1.640028, 23.98fps, mp4a.40.2
hls-1433-1   mp4        1920x1080  1433k , avc1.640028, 23.98fps, mp4a.40.2
hls-1433-2   mp4        1920x1080  1433k , avc1.640028, 23.98fps, mp4a.40.2 (best)

./dl -t http://www.crunchyroll.com/interviews-with-monster-girls/episode-2-dullahan-chan-wants-to-be-coddled-728569 -F
[Crunchyroll] 728569: Downloading webpage
[Crunchyroll] 728569: Downloading media info for 360p
[Crunchyroll] 728569: Downloading media info for 480p
[Crunchyroll] 728569: Downloading media info for 720p
[Crunchyroll] 728569: Downloading media info for 1080p
[Crunchyroll] 728569: Downloading media info
[Crunchyroll] 728569: Downloading subtitles for English (US)
[Crunchyroll] 728569: Downloading subtitles for Español
[Crunchyroll] 728569: Downloading subtitles for Español (España)
[Crunchyroll] 728569: Downloading subtitles for Français (France)
[Crunchyroll] 728569: Downloading subtitles for Português (Brasil)
[Crunchyroll] 728569: Downloading subtitles for العربية
[Crunchyroll] 728569: Downloading subtitles for Italiano
[Crunchyroll] 728569: Downloading subtitles for Deutsch
[info] Available formats for 728569:
format code  extension  resolution note
360p         flv        656x368
480p         flv        848x480
720p         flv        1280x720
1080p        flv        1920x1080  (best)
@a4840639
Copy link
Author

@a4840639 a4840639 commented Jan 18, 2017

Okay I kind of get it. Maybe the strategy Crunchyroll adopted is hosting flv for new strems and replace those streams with lower bitrate ones after a few days. I am really sad that I have to go pirate in order to watch higher quality Anime.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
3 participants
You can’t perform that action at this time.