Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ERROR: Unable to extract video id;RegexNotFoundError: Unable to extract video id; #4340

Closed
gilles-c opened this issue Nov 30, 2014 · 6 comments
Closed

Comments

@gilles-c
Copy link

@gilles-c gilles-c commented Nov 30, 2014

Here the output today :

$ youtube-dl -Fs --verbose http://www.francetvinfo.fr/replay-jt/france-2/20-heures/jt-de-20h-du-dimanche-30-novembre-2014_752591.html
[debug] System config: []
[debug] User config: []
[debug] Command-line args: ['-Fs', '--verbose', 'http://www.francetvinfo.fr/replay-jt/france-2/20-heures/jt-de-20h-du-dimanche-30-novembre-2014_752591.html']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2014.11.27
[debug] Python version 2.7.3 - Linux-3.2.0-4-powerpc-smp-ppc-with-debian-7.7
[debug] exe versions: avconv 0.8.16-6, avprobe 0.8.16-6, ffmpeg 0.8.16-6, ffprobe 0.8.16-6
[debug] Proxy map: {}
[francetvinfo.fr] jt-de-20h-du-dimanche-30-novembre-2014_752591: Downloading webpage
ERROR: Unable to extract video id; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type youtube-dl -U to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 553, in extract_info
ie_result = ie.extract(url)
File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 240, in extract
return self._real_extract(url)
File "/usr/local/bin/youtube-dl/youtube_dl/extractor/francetv.py", line 139, in _real_extract
r'id-video=([^@]+@[^"]+)', webpage, 'video id').split('@')
File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 480, in _search_regex
raise RegexNotFoundError('Unable to extract %s' % _name)
RegexNotFoundError: Unable to extract video id; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type youtube-dl -U to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

@jaimeMF
Copy link
Collaborator

@jaimeMF jaimeMF commented Nov 30, 2014

It works for me. Can you watch the video on a browser? if so, could you run youtube-dl 'http://www.francetvinfo.fr/replay-jt/france-2/20-heures/jt-de-20h-du-dimanche-30-novembre-2014_752591.html' --write-pages and post the *.dump files somewher (like a Gist?

@gilles-c
Copy link
Author

@gilles-c gilles-c commented Dec 1, 2014

1] I can not watch this video on iceweasel, web-epiphany QupZilla browsers. However when I type a command line : youtube-dl 'http://www.francetvinfo.fr/replay-jt/france-2/20-heures/jt-de-20h-du-dimanche-30-novembre-2014_752591.html' --write-pages

:/youtube-dl-debug$ youtube-dl 'http://www.francetvinfo.fr/replay-jt/france-2/20-heures/jt-de-20h-du-dimanche-30-novembre-2014_752591.html' --write-pages
[francetvinfo.fr] jt-de-20h-du-dimanche-30-novembre-2014_752591: Downloading webpage
[francetvinfo.fr] Saving request to jt-de-20h-du-dimanche-30-novembre-2014_752591_http_-www.francetvinfo.fr_replay-jt_france-2_20-heures_jt-de-20h-du-dimanche-30-novembre-2014_752591.html.dump
[francetvinfo.fr] 113263271: Downloading video JSON
[francetvinfo.fr] Saving request to 113263271_http
-webservices.francetelevisions.fr_tools_getInfosOeuvre_v2_idDiffusion=113263271_catalogue=Info-web.dump
[francetvinfo.fr] 113263271: Downloading f4m manifest token
[francetvinfo.fr] Saving request to 113263271_http
-_hdfauth.francetv.fr_esi_urltokengen2.htmlurl=_z_streaming-adaptatif_2014_S48_J7_113263271-20141130-398_632_934_k.mp4.csmil_manifest.f4m.dump
[francetvinfo.fr] 113263271: Downloading f4m manifest
[francetvinfo.fr] Saving request to 113263271_http
-_ftvodhdsecz-f.akamaihd.net_z_streaming-adaptatif_2014_S48_J7_113263271-20141130-_398_632_934_k.mp4.csmil_manifest.f4mhdnea=exp=1417422029
acl=%2fz%2fstreaming-adaptatif%2f2014%2fS48%2fJ7_4446696fc0b0cf088656a5ada10e501a.dump
[francetvinfo.fr] 113263271: Downloading m3u8 information
[francetvinfo.fr] Saving request to 113263271_http_-_ftvodhdsecz-f.akamaihd.net_i_streaming-adaptatif_2014_S48_J7_113263271-20141130-_398_632_934_k.mp4.csmil_master.m3u8.dump
[download] Downloading f4m manifest
[download] Destination: Journal-113263271.flv
[download] 100% of 277.05MiB in 05:16

I have a .flv file, that I can read. The .dump files archivied in tar.bz2 is here : http://âpp.com/Hfyi

2] So if flv works with --write-pages option, I wanted to download a mp4 file. So I simulate :
youtube-dl -Fs --verbose http://www.francetvinfo.fr/replay-jt/france-2/20-heures/jt-de-20h-du-dimanche-30-novembre-2014_752591.html
[debug] System config: []
[debug] User config: []
[debug] Command-line args: ['-Fs', '--verbose', 'http://www.francetvinfo.fr/replay-jt/france-2/20-heures/jt-de-20h-du-dimanche-30-novembre-2014_752591.html']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2014.11.27
[debug] Python version 2.7.3 - Linux-3.2.0-4-powerpc-smp-ppc-with-debian-7.7
[debug] exe versions: avconv 0.8.16-6, avprobe 0.8.16-6, ffmpeg 0.8.16-6, ffprobe 0.8.16-6
[debug] Proxy map: {}
[francetvinfo.fr] jt-de-20h-du-dimanche-30-novembre-2014_752591: Downloading webpage
[francetvinfo.fr] 113263271: Downloading video JSON
[francetvinfo.fr] 113263271: Downloading f4m manifest token
[francetvinfo.fr] 113263271: Downloading f4m manifest
[francetvinfo.fr] 113263271: Downloading m3u8 information
[info] Available formats for 113263271:
format code extension resolution note
m3u8-meta mp4 multiple Quality selection URL (worst)
m3u8-302 mp4 320x180 302k , avc1, mp4a
m3u8-571 mp4 512x288 571k , avc1, mp4a
m3u8-822 mp4 704x396 822k , avc1, mp4a
f4m-302 flv unknown 302k
f4m-571 flv unknown 571k
f4m-822 flv unknown 822k (best)

Good, I have thinked, so I type :

youtube-dl -f m3u8-302 --verbose http://www.francetvinfo.fr/replay-jt/france-2/20-heures/jt-de-20h-du-dimanche-30-novembre-2014_752591.html
[debug] System config: []
[debug] User config: []
[debug] Command-line args: ['-f', 'm3u8-302', '--verbose', 'http://www.francetvinfo.fr/replay-jt/france-2/20-heures/jt-de-20h-du-dimanche-30-novembre-2014_752591.html']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2014.11.27
[debug] Python version 2.7.3 - Linux-3.2.0-4-powerpc-smp-ppc-with-debian-7.7
[debug] exe versions: avconv 0.8.16-6, avprobe 0.8.16-6, ffmpeg 0.8.16-6, ffprobe 0.8.16-6
[debug] Proxy map: {}
[francetvinfo.fr] jt-de-20h-du-dimanche-30-novembre-2014_752591: Downloading webpage
[francetvinfo.fr] 113263271: Downloading video JSON
[francetvinfo.fr] 113263271: Downloading f4m manifest token
[francetvinfo.fr] 113263271: Downloading f4m manifest
[francetvinfo.fr] 113263271: Downloading m3u8 information
[debug] Invoking downloader on u'http://ftvodhdsecz-f.akamaihd.net/i/streaming-adaptatif/2014/S48/J7/113263271-20141130-,398,632,934,k.mp4.csmil/index_0_av.m3u8?null='
[download] Destination: Journal-113263271.mp4
avconv version 0.8.16-6:0.8.16-1, Copyright (c) 2000-2014 the Libav developers
built on Sep 17 2014 13:36:07 with gcc 4.6.3
[applehttp @ 0x102d3ce0] Estimating duration from bitrate, this may be inaccurate
Input #0, applehttp, from 'http://ftvodhdsecz-f.akamaihd.net/i/streaming-adaptatif/2014/S48/J7/113263271-20141130-,398,632,934,k.mp4.csmil/index_0_av.m3u8?null=':
Duration: 00:46:28.00, start: 10.101000, bitrate: N/A
Stream #0.0: Video: h264 (Constrained Baseline), yuv420p, 320x180 [PAR 1:1 DAR 16:9], 25 tbr, 90k tbn, 50 tbc
Stream #0.1: Audio: aac, 48000 Hz, stereo, s16
Output #0, mp4, to 'Journal-113263271.mp4.part':
Metadata:
encoder : Lavf53.21.1
Stream #0.0: Video: libx264, yuv420p, 320x180 [PAR 1:1 DAR 16:9], q=2-31, 90k tbn, 90k tbc
Stream #0.1: Audio: aac, 48000 Hz, stereo
Stream mapping:
Stream #0:0 -> #0:0 (copy)
Stream #0:1 -> #0:1 (copy)
Press ctrl-c to stop encoding
[mp4 @ 0x1052eec0] Application provided invalid, non monotonically increasing dts to muxer in stream 1: 240 >= 240
av_interleaved_write_frame(): Invalid argument

ERROR: avconv exited with code 1
File "/usr/lib/python2.7/runpy.py", line 162, in _run_module_as_main
"main", fname, loader, pkg_name)
File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
exec code in run_globals
File "/usr/local/bin/youtube-dl/main.py", line 19, in
youtube_dl.main()
File "/usr/local/bin/youtube-dl/youtube_dl/init.py", line 355, in main
_real_main(argv)
File "/usr/local/bin/youtube-dl/youtube_dl/init.py", line 345, in _real_main
retcode = ydl.download(all_urls)
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 1117, in download
res = self.extract_info(url)
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 564, in extract_info
return self.process_ie_result(ie_result, download, extra_info)
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 610, in process_ie_result
return self.process_video_result(ie_result, download=download)
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 893, in process_video_result
self.process_info(new_info)
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 1087, in process_info
success = dl(filename, info_dict)
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 1063, in dl
return fd.download(name, info)
File "/usr/local/bin/youtube-dl/youtube_dl/downloader/common.py", line 294, in download
return self.real_download(filename, info_dict)
File "/usr/local/bin/youtube-dl/youtube_dl/downloader/hls.py", line 49, in real_download
self.report_error('%s exited with code %d' % (program, retval))
File "/usr/local/bin/youtube-dl/youtube_dl/downloader/common.py", line 147, in report_error
self.ydl.report_error(_args, *_kargs)
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 439, in report_error
self.trouble(error_message, tb)
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 401, in trouble
tb_data = traceback.format_list(traceback.extract_stack())

I can not download this mp4 file and maybe the others mp4 files.

@gilles-c
Copy link
Author

@gilles-c gilles-c commented Dec 1, 2014

I have made a new test :
mkdir youtube-dl-debug-mp4
intervenant0@tapez-votre-commande-shell:$ cd youtube-dl-debug-mp4/
intervenant0@tapez-votre-commande-shell:
/youtube-dl-debug-mp4$ youtube-dl -f m3u8-302 --verbose --write-pages http://www.francetvinfo.fr/replay-jt/france-2/20-heures/jt-de-20h-du-dimanche-30-novembre-2014_752591.html
[debug] System config: []
[debug] User config: []
[debug] Command-line args: ['-f', 'm3u8-302', '--verbose', '--write-pages', 'http://www.francetvinfo.fr/replay-jt/france-2/20-heures/jt-de-20h-du-dimanche-30-novembre-2014_752591.html']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2014.11.27
[debug] Python version 2.7.3 - Linux-3.2.0-4-powerpc-smp-ppc-with-debian-7.7
[debug] exe versions: avconv 0.8.16-6, avprobe 0.8.16-6, ffmpeg 0.8.16-6, ffprobe 0.8.16-6
[debug] Proxy map: {}
[francetvinfo.fr] jt-de-20h-du-dimanche-30-novembre-2014_752591: Downloading webpage
[francetvinfo.fr] Saving request to jt-de-20h-du-dimanche-30-novembre-2014_752591_http_-www.francetvinfo.fr_replay-jt_france-2_20-heures_jt-de-20h-du-dimanche-30-novembre-2014_752591.html.dump
[francetvinfo.fr] 113263271: Downloading video JSON
[francetvinfo.fr] Saving request to 113263271_http
-webservices.francetelevisions.fr_tools_getInfosOeuvre_v2_idDiffusion=113263271_catalogue=Info-web.dump
[francetvinfo.fr] 113263271: Downloading f4m manifest token
[francetvinfo.fr] Saving request to 113263271_http
-_hdfauth.francetv.fr_esi_urltokengen2.htmlurl=_z_streaming-adaptatif_2014_S48_J7_113263271-20141130-398_632_934_k.mp4.csmil_manifest.f4m.dump
[francetvinfo.fr] 113263271: Downloading f4m manifest
[francetvinfo.fr] Saving request to 113263271_http
-_ftvodhdsecz-f.akamaihd.net_z_streaming-adaptatif_2014_S48_J7_113263271-20141130-398_632_934_k.mp4.csmil_manifest.f4mhdnea=exp=1417427147~acl=%2fz%2fstreaming-adaptatif%2f2014%2fS48%2fJ7_74f99f18c43fee0b7c92b70413a5e8ba.dump
[francetvinfo.fr] 113263271: Downloading m3u8 information
[francetvinfo.fr] Saving request to 113263271_http
-_ftvodhdsecz-f.akamaihd.net_i_streaming-adaptatif_2014_S48_J7_113263271-20141130-_398_632_934_k.mp4.csmil_master.m3u8.dump
[debug] Invoking downloader on u'http://ftvodhdsecz-f.akamaihd.net/i/streaming-adaptatif/2014/S48/J7/113263271-20141130-,398,632,934,k.mp4.csmil/index_0_av.m3u8?null='
[download] Destination: Journal-113263271.mp4
avconv version 0.8.16-6:0.8.16-1, Copyright (c) 2000-2014 the Libav developers
built on Sep 17 2014 13:36:07 with gcc 4.6.3
[applehttp @ 0x101eece0] Estimating duration from bitrate, this may be inaccurate
Input #0, applehttp, from 'http://ftvodhdsecz-f.akamaihd.net/i/streaming-adaptatif/2014/S48/J7/113263271-20141130-,398,632,934,k.mp4.csmil/index_0_av.m3u8?null=':
Duration: 00:46:28.00, start: 10.101000, bitrate: N/A
Stream #0.0: Video: h264 (Constrained Baseline), yuv420p, 320x180 [PAR 1:1 DAR 16:9], 25 tbr, 90k tbn, 50 tbc
Stream #0.1: Audio: aac, 48000 Hz, stereo, s16
Output #0, mp4, to 'Journal-113263271.mp4.part':
Metadata:
encoder : Lavf53.21.1
Stream #0.0: Video: libx264, yuv420p, 320x180 [PAR 1:1 DAR 16:9], q=2-31, 90k tbn, 90k tbc
Stream #0.1: Audio: aac, 48000 Hz, stereo
Stream mapping:
Stream #0:0 -> #0:0 (copy)
Stream #0:1 -> #0:1 (copy)
Press ctrl-c to stop encoding
[mp4 @ 0x10451dc0] Application provided invalid, non monotonically increasing dts to muxer in stream 1: 240 >= 240
av_interleaved_write_frame(): Invalid argument

ERROR: avconv exited with code 1
File "/usr/lib/python2.7/runpy.py", line 162, in _run_module_as_main
"main", fname, loader, pkg_name)
File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
exec code in run_globals
File "/usr/local/bin/youtube-dl/main.py", line 19, in
youtube_dl.main()
File "/usr/local/bin/youtube-dl/youtube_dl/init.py", line 355, in main
_real_main(argv)
File "/usr/local/bin/youtube-dl/youtube_dl/init.py", line 345, in _real_main
retcode = ydl.download(all_urls)
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 1117, in download
res = self.extract_info(url)
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 564, in extract_info
return self.process_ie_result(ie_result, download, extra_info)
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 610, in process_ie_result
return self.process_video_result(ie_result, download=download)
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 893, in process_video_result
self.process_info(new_info)
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 1087, in process_info
success = dl(filename, info_dict)
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 1063, in dl
return fd.download(name, info)
File "/usr/local/bin/youtube-dl/youtube_dl/downloader/common.py", line 294, in download
return self.real_download(filename, info_dict)
File "/usr/local/bin/youtube-dl/youtube_dl/downloader/hls.py", line 49, in real_download
self.report_error('%s exited with code %d' % (program, retval))
File "/usr/local/bin/youtube-dl/youtube_dl/downloader/common.py", line 147, in report_error
self.ydl.report_error(_args, *_kargs)
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 439, in report_error
self.trouble(error_message, tb)
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 401, in trouble
tb_data = traceback.format_list(traceback.extract_stack())

The compressed dump files are here : http://âpp.com/Hfyj

@jaimeMF
Copy link
Collaborator

@jaimeMF jaimeMF commented Dec 1, 2014

It could be a problem with the version of avconv, it works fine for me with avconv 11 and ffmpeg 2.4.3. You could try upgrading to a more recent version.

@gilles-c
Copy link
Author

@gilles-c gilles-c commented Dec 1, 2014

I think you are right..
My version of ffmpeg is deprecated, more than that, for debian ffmpeg is deprecated and just a transitional package.
https://packages.debian.org/ru/wheezy/ffmpeg

1] Maybe I must build the last version of static librairy of ffmpeg and after must change the $LD_LIBRARY_PATH and after run youtube-dl

2] Maybe I must install the version of libav-tools included in debian 8 ( jessie )

3] Maybe I must wait the next version of Debian

@clampak
Copy link

@clampak clampak commented Dec 15, 2014

@gilles-c if this isn't fixed for you, try the suggestions in #4471

@gilles-c gilles-c closed this Jul 27, 2015
@ytdl-org ytdl-org locked and limited conversation to collaborators Apr 26, 2017
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
3 participants
You can’t perform that action at this time.