Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Testing new NFL extractor... #3831

Closed
RingoTheDog opened this issue Sep 25, 2014 · 4 comments
Closed

Testing new NFL extractor... #3831

RingoTheDog opened this issue Sep 25, 2014 · 4 comments

Comments

@RingoTheDog
Copy link

@RingoTheDog RingoTheDog commented Sep 25, 2014

Great to see the new NFL extractor, but while I was experimenting discovered a few URLs that it failed on:

These are the same video:
http://www.seahawks.clubs.nfl.com/videos-photos/videos/Week-3-Performance-Moments/eb76a2e1-0d88-4d5f-afeb-d7e9103e813a
http://prod.www.seahawks.clubs.nfl.com/videos-photos/videos/Week-3-Performance-Moments/eb76a2e1-0d88-4d5f-afeb-d7e9103e813a

(each NFL team has own microsite)

youtube-dl.py -v http://prod.www.seahawks.clubs.nfl.com/videos-photos/videos/Week-3-Performance-Moments/eb76a2e1-0d88-4d5f-afeb-d7e9103e813a
[debug] System config: []
[debug] User config: []
[debug] Command-line args: ['-v', 'http://prod.www.seahawks.clubs.nfl.com/videos-photos/videos/Week-3-Performance-Moments/eb76a2e1-0d88-4d5f-afeb-d7e9103e813a']
[debug] Encodings: locale cp1252, fs mbcs, out cp850, pref cp1252
[debug] youtube-dl version 2014.09.25
[debug] Python version 2.7.5 - Windows-7-6.1.7601-SP1
[debug] Proxy map: {}
[generic] eb76a2e1-0d88-4d5f-afeb-d7e9103e813a: Requesting header
WARNING: Falling back on generic information extractor.
[generic] eb76a2e1-0d88-4d5f-afeb-d7e9103e813a: Downloading webpage
[generic] eb76a2e1-0d88-4d5f-afeb-d7e9103e813a: Extracting information
ERROR: Unsupported URL: http://prod.www.seahawks.clubs.nfl.com/videos-photos/videos/Week-3-Performance-Moments/eb76a2e1-0d88-4d5f-afeb-d7e9103e813a; please report this issue on https://yt-dl.org/bug .
Be sure to call youtube-dl with the --verbose flag and include its complete output. Make sure you are using the latest version; type youtube-dl -U to update.
Traceback (most recent call last):
File "C:\Transmogrifier\youtube-dl.py\youtube_dl\extractor\generic.py", line 545, in _real_extract
doc = parse_xml(webpage)
File "C:\Transmogrifier\youtube-dl.py\youtube_dl\utils.py", line 1509, in parse_xml
tree = xml.etree.ElementTree.XML(s.encode('utf-8'), **kwargs)
File "C:\Python27\lib\xml\etree\ElementTree.py", line 1300, in XML
parser.feed(text)
File "C:\Python27\lib\xml\etree\ElementTree.py", line 1642, in feed
self._raiseerror(v)
File "C:\Python27\lib\xml\etree\ElementTree.py", line 1506, in _raiseerror
raise err
ParseError: mismatched tag: line 219, column 106
Traceback (most recent call last):
File "C:\Transmogrifier\youtube-dl.py\youtube_dl\YoutubeDL.py", line 524, in extract_info
ie_result = ie.extract(url)
File "C:\Transmogrifier\youtube-dl.py\youtube_dl\extractor\common.py", line 181, in extract
return self._real_extract(url)
File "C:\Transmogrifier\youtube-dl.py\youtube_dl\extractor\generic.py", line 892, in _real_extract
raise ExtractorError('Unsupported URL: %s' % url)
ExtractorError: Unsupported URL: http://prod.www.seahawks.clubs.nfl.com/videos-photos/videos/Week-3-Performance-Moments/eb76a2e1-0d88-4d5f-afeb-d7e9103e813a; please report this issue on https://yt-dl.
org/bug . Be sure to call youtube-dl with the --verbose flag and include its complete output. Make sure you are using the latest version; type youtube-dl -U to update.

AND....

http://www.nfl.com/videos/nfl-videos/0ap3000000400501/Ryan-Suh-the-modern-day-version-of-Sapp

This clip is only 1:29 but reports as 2GB file and then fails with Content Too Short

youtube-dl.py -v http://www.nfl.com/videos/nfl-videos/0ap3000000400501/Ryan-Suh-the-modern-day-version-of-Sapp
[debug] System config: []
[debug] User config: []
[debug] Command-line args: ['-v', 'http://www.nfl.com/videos/nfl-videos/0ap3000000400501/Ryan-Suh-the-modern-day-version-of-Sapp']
[debug] Encodings: locale cp1252, fs mbcs, out cp850, pref cp1252
[debug] youtube-dl version 2014.09.25
[debug] Python version 2.7.5 - Windows-7-6.1.7601-SP1
[debug] Proxy map: {}
[nfl.com] 0ap3000000400501: Downloading player config
[nfl.com] 0ap3000000400501: Downloading JSON metadata
[debug] Invoking downloader on u'http://vod.hstream.video.nfl.com/films/2014/nfl_com/nflcom/reg/04/140925_dc_excl_ryan_cmpares_suh_on_sapp_3200k.mp4'
[download] Destination: New York Jets head coach Rex Ryan - Suh the modern day version of Sapp-0ap3000000400501.mp4
[download] 100% of 2.00GiB in 01:21
ERROR: content too short (expected 2147483647 bytes and served 33896861)
Traceback (most recent call last):
File "C:\Transmogrifier\youtube-dl.py\youtube_dl\YoutubeDL.py", line 1037, in process_info
success = dl(filename, info_dict)
File "C:\Transmogrifier\youtube-dl.py\youtube_dl\YoutubeDL.py", line 1013, in dl
return fd.download(name, info)
File "C:\Transmogrifier\youtube-dl.py\youtube_dl\downloader\common.py", line 292, in download
return self.real_download(filename, info_dict)
File "C:\Transmogrifier\youtube-dl.py\youtube_dl\downloader\http.py", line 198, in real_download
raise ContentTooShortError(byte_counter, int(data_len))
ContentTooShortError

Thanks in advance
Ringo

@naglis
Copy link
Collaborator

@naglis naglis commented Sep 25, 2014

Hi, @RingoTheDog,

thank you for your report! However, next time be sure to open separate issues for different problems, it is easier to track solved/unsolved issues that way.

For the first issue - I will see if it can be supported when I have a bit more time, maybe on the weekend.

As for the second issue - for the time being use youtube-dl <URL> -F to see the available formats, and pick a format code with akamaiProg streaming, for example for your given URL the format code of the highest quality with akamaiProg streaming would be 9. The run youtube-dl <URL> -f <format_code> to download it. akamaiProg seems to provide more reasonable filesizes. I guess it should be made the prefered one.

@RingoTheDog
Copy link
Author

@RingoTheDog RingoTheDog commented Sep 25, 2014

Thanks man!!
Amazing as always!

@naglis naglis closed this in 5f4c318 Sep 28, 2014
@naglis
Copy link
Collaborator

@naglis naglis commented Sep 28, 2014

Support for team micro-sites as in the provided URL has been added and will be available in the next version of youtube-dl.

@phihag
Copy link
Contributor

@phihag phihag commented Sep 29, 2014

Fixed in youtube-dl 2014.09.29. Type youtube-dl.py -U to update.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
4 participants
@phihag @naglis @RingoTheDog and others
You can’t perform that action at this time.