unable to download videos from ustreamtv #2670

shirishag75 · 2014-04-02T05:23:15Z

Hi all,
This is on an older version of youtube-dl :-

$ youtube-dl -vv -F http://www.ustream.tv/recorded/44902811
[debug] System config: []
[debug] User config: []
[debug] Command-line args: ['-vv', '-F', 'http://www.ustream.tv/recorded/44902811']
[debug] Encodings: locale 'UTF-8', fs 'UTF-8', out 'UTF-8', pref: 'UTF-8'
[debug] youtube-dl version 2014.02.17
[debug] Python version 2.7.6 - Linux-3.13-1-amd64-x86_64-with-debian-jessie-sid
[debug] Proxy map: {}
[ustream] 44902811: Downloading webpage
[ustream] 44902811: Extracting information
[info] Available formats for 44902811:
format code extension resolution  note 
0           flv       unknown     
$

Can anybody try this and see if it works with the newer versions perhaps or it's something to do with the site itself ?

jaimeMF · 2014-04-02T06:23:03Z

It works fine here, can you post the output of youtube-dl -v http://www.ustream.tv/recorded/44902811?

shoaib-s · 2014-04-02T11:00:03Z

./youtube-dl --verbose http://www.ustream.tv/recorded/44902811
[debug] System config: []
[debug] User config: []
[debug] Command-line args: ['--verbose', 'http://www.ustream.tv/recorded/44902811']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2014.04.01.3
[debug] Python version 2.7.3 - Linux-3.2.0-23-generic-x86_64-with-LinuxMint-13-maya
[debug] Proxy map: {}
[ustream] 44902811: Downloading webpage
[ustream] 44902811: Extracting information
ERROR: Unable to extract title; please report this issue on https://yt-dl.org/bug . Be sure to call youtube-dl with the --verbose flag and include its complete output. Make sure you are using the latest version; type youtube-dl -U to update.
Traceback (most recent call last):
File "./youtube-dl/youtube_dl/YoutubeDL.py", line 511, in extract_info
ie_result = ie.extract(url)
File "./youtube-dl/youtube_dl/extractor/common.py", line 161, in extract
return self._real_extract(url)
File "./youtube-dl/youtube_dl/extractor/ustream.py", line 36, in _real_extract
webpage, 'title')
File "./youtube-dl/youtube_dl/extractor/common.py", line 369, in _html_search_regex
res = self._search_regex(pattern, string, name, default, fatal, flags)
File "./youtube-dl/youtube_dl/extractor/common.py", line 359, in _search_regex
raise RegexNotFoundError(u'Unable to extract %s' % _name)
RegexNotFoundError: Unable to extract title; please report this issue on https://yt-dl.org/bug . Be sure to call youtube-dl with the --verbose flag and include its complete output. Make sure you are using the latest version; type youtube-dl -U to update.

shoaib@shoaib-T420:~/Study/openSourceProjects/youtube-dl$ ./youtube-dl -U
youtube-dl is up-to-date (2014.04.01.3)

shoaib-s · 2014-04-02T11:03:26Z

./youtube-dl --verbose http://www.ustream.tv/recorded/44902811
[debug] System config: []
[debug] User config: []
[debug] Command-line args: ['--verbose', 'http://www.ustream.tv/recorded/44902811']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2014.04.01.3
[debug] Python version 2.7.3 - Linux-3.2.0-23-generic-x86_64-with-LinuxMint-13-maya
[debug] Proxy map: {}
[ustream] 44902811: Downloading webpage
[ustream] 44902811: Extracting information
ERROR: Unable to extract title; please report this issue on https://yt-dl.org/bug . Be sure to call youtube-dl with the --verbose flag and include its complete output. Make sure you are using the latest version; type youtube-dl -U to update.
Traceback (most recent call last):
File "./youtube-dl/youtube_dl/YoutubeDL.py", line 511, in extract_info
ie_result = ie.extract(url)
File "./youtube-dl/youtube_dl/extractor/common.py", line 161, in extract
return self._real_extract(url)
File "./youtube-dl/youtube_dl/extractor/ustream.py", line 36, in _real_extract
webpage, 'title')
File "./youtube-dl/youtube_dl/extractor/common.py", line 369, in _html_search_regex
res = self._search_regex(pattern, string, name, default, fatal, flags)
File "./youtube-dl/youtube_dl/extractor/common.py", line 359, in _search_regex
raise RegexNotFoundError(u'Unable to extract %s' % _name)
RegexNotFoundError: Unable to extract title; please report this issue on https://yt-dl.org/bug . Be sure to call youtube-dl with the --verbose flag and include its complete output. Make sure you are using the latest version; type youtube-dl -U to update.

shoaib@shoaib-T420:~/Study/openSourceProjects/youtube-dl$ ./youtube-dl -U
youtube-dl is up-to-date (2014.04.01.3)

phihag · 2014-04-02T11:33:54Z

@shoaib1987 Thank you, we got that post the first time ;) This problem is strange, it works fine for me as well. Which ISP do you use?

Can you add --dump-intermediate-pages and post that output? Warning, it will be very verbose. And posting it once is sufficient ;)

shirishag75 · 2014-04-02T11:57:15Z

hi all,
Sorry for not sharing. I saw this happening later .

$youtube-dl -v http://www.ustream.tv/recorded/44902811
[debug] System config: []
[debug] User config: []
[debug] Command-line args: ['-v', 'http://www.ustream.tv/recorded/44902811']
[debug] Encodings: locale 'UTF-8', fs 'UTF-8', out 'UTF-8', pref: 'UTF-8'
[debug] youtube-dl version 2014.02.17
[debug] Python version 2.7.6 - Linux-3.13-1-amd64-x86_64-with-debian-jessie-sid
[debug] Proxy map: {}
[ustream] 44902811: Downloading webpage
[ustream] 44902811: Extracting information
[download] Destination: SAFECAST - The Next Three Years, Ocean, Food, and Health Trends-44902811.flv
[download] 100% of 1.68GiB in 04:57:15

Don't know why it didn't work the first time (without the --verbose flags) and the -vv as well.

shoaib-s · 2014-04-02T12:24:55Z

Sorry for posting it several times. It has happened unknowingly.

Still not working on my machine.
./youtube-dl --dump-intermediate-pages http://www.ustream.tv/recorded/44902811
[ustream] 44902811: Downloading webpage
[ustream] Dumping request to http://www.ustream.tv/recorded/44902811
PCFET0NUWVBFIEhUTUwgUFVCTElDICItLy9XM0MvL0RURCBIVE1MIDQuMDEgVHJhbnNpdGlvbmFsLy9FTiIgImh0dHA6Ly93d3cudzMub3JnL1RSL2h0bWw0L2xvb3NlLmR0ZCI+Cgo8IS0tLy8vLy8vLy8vLy8vLy8vLy8vLy8vLy8vLy8vLy8vLy8vLy8vLy8vLy8vLy8vLy8vLy8vLy8vLy8vLy8vLy8vLy8vLy8vLy8vLy8KLy8KLy8gICAgQ29weXJpZ2h0IChjKSAxOTk2IC0gMjAxMSwgV2Vic2Vuc2UsIEluYy4gICAgQWxsIFJpZ2h0cyBSZXNlcnZlZAovLyAgICBTZWUgV2Vic2Vuc2VDb3B5cmlnaHQudHh0IGZvciBjb3B5cmlnaHQgaW5mb3JtYXRpb24KLy8KLy8vLy8vLy8vLy8vLy8vLy8vLy8vLy8vLy8vLy8vLy8vLy8vLy8vLy8vLy8vLy8vLy8vLy8vLy8vLy8vLy8vLy8vLy8vLy8vLy8vLS0+Cgo8aHRtbD4KPGhlYWQ+CjxtZXRhIGh0dHAtZXF1aXY9IkNvbnRlbnQtVHlwZSIgY29udGVudD0idGV4dC9odG1sOyBjaGFyc2V0PVVURi04Ij4KPHRpdGxlPkFjY2VzcyB0byB0aGlzIHNpdGUgaXMgYmxvY2tlZDwvdGl0bGU+CjxsaW5rIHJlbD0ic3R5bGVzaGVldCIgaHJlZj0iL2VuL0RlZmF1bHQvbWFzdGVyLmNzcyIgdHlwZT0idGV4dC9jc3MiPgo8c2NyaXB0IHR5cGU9InRleHQvamF2YXNjcmlwdCIgbGFuZ3VhZ2U9ImphdmFzY3JpcHQiIHNyYz0iL2VuL0RlZmF1bHQvbWFzdGVyLmpzIj48L3NjcmlwdD4KPHNjcmlwdCB0eXBlPSJ0ZXh0L2phdmFzY3JpcHQiIGxhbmd1YWdlPSJqYXZhc2NyaXB0IiBzcmM9Ii9lbi9EZWZhdWx0L2Jhc2U2NC5qcyI+PC9zY3JpcHQ+CjxzY3JpcHQgdHlwZT0idGV4dC9qYXZhc2NyaXB0IiBsYW5ndWFnZT0iamF2YXNjcmlwdCIgc3JjPSIvZW4vRGVmYXVsdC9zZWN1cml0eS5qcyI+PC9zY3JpcHQ+CjwvaGVhZD4KPGJvZHk+Cgo8IS0tW2lmIGx0IElFIDddPiA8ZGl2IHN0eWxlPSJ3aWR0aDogNzI1cHg7Ij4gPCFbZW5kaWZdLS0+CjxkaXYgc3R5bGU9ImJvcmRlcjogMXB4IHNvbGlkICMyODVFQTY7d2lkdGg6IDk1JTsgbWF4LXdpZHRoOiA3MDBweDsgb3ZlcmZsb3c6IGhpZGRlbjsgbWFyZ2luLWxlZnQ6IDEwcHg7IGJhY2tncm91bmQtY29sb3I6ICNFRUYyRjc7Ij4KCTxpZnJhbWUgc3JjPSJodHRwOi8vMTcyLjIwLjIuNzoxNTg3MS9jZ2ktYmluL2Jsb2NrX21lc3NhZ2UuY2dpP3dzLXNlc3Npb249MTc2MTcwMDA2MCIgdGl0bGU9InRlc3QiIG5hbWU9IndzX2Jsb2NrIiBmcmFtZWJvcmRlcj0iMCIgc2Nyb2xsaW5nPSJhdXRvIiBzdHlsZT0id2lkdGg6MTAwJTsgaGVpZ2h0OiAxMGVtOyI+CgoJPC9pZnJhbWU+Cgk8aWZyYW1lIHNyYz0iaHR0cDovLzE3Mi4yMC4yLjc6MTU4NzEvY2dpLWJpbi9ibG9ja09wdGlvbnMuY2dpP3dzLXNlc3Npb249MTc2MTcwMDA2MCIgbmFtZT0id3NfYmxvY2tvcHRpb24iIGZyYW1lYm9yZGVyPSIwIiBzY3JvbGxpbmc9ImF1dG8iIHN0eWxlPSJ3aWR0aDoxMDAlOyBoZWlnaHQ6IDE3LjVlbTsiPgoJCTxwPlRvIGVuYWJsZSBmdXJ0aGVyIG9wdGlvbnMsIHZpZXcgdGhpcyBwYWdlIHdpdGggYSBicm93c2VyIHRoYXQgc3VwcG9ydHMgaWZyYW1lczwvcD4KCTwvaWZyYW1lPgoJPGRpdj48aW1nIHRpdGxlPSJXZWJzZW5zZSIgc3JjPSIvSW1hZ2VzL3dzbG9nb19ibG9ja19wYWdlLnBuZyIgYWx0PSJXZWJzZW5zZSBMb2dvIiBzdHlsZT0iZmxvYXQ6IHJpZ2h0O2NsZWFyOiBib3RoO21hcmdpbjogMHB4IDEwcHggNnB4IDBweDsgcGFkZGluZzogMnB4IDBweDsiPgoJCTxkaXYgc3R5bGU9ImNsZWFyOiBib3RoOyBvdmVyZmxvdzogaGlkZGVuOyBoZWlnaHQ6MXB4OyI+PC9kaXY+Cgk8L2Rpdj4KPC9kaXY+CjwhLS1baWYgbHQgSUUgN10+IDwvZGl2PiA8IVtlbmRpZl0tLT4KPGRpdiBpZD0ibGlnaHQiIGNsYXNzPSJ3aGl0ZV9jb250ZW50Ij48L2Rpdj4KPGRpdiBpZD0iZmFkZSIgY2xhc3M9ImJsYWNrX292ZXJsYXkiPjwvZGl2Pgo8L2JvZHk+CjwvaHRtbD4K
[ustream] 44902811: Extracting information
ERROR: Unable to extract title; please report this issue on https://yt-dl.org/bug . Be sure to call youtube-dl with the --verbose flag and include its complete output. Make sure you are using the latest version; type youtube-dl -U to update.

jaimeMF · 2014-04-02T12:28:45Z

Can you access the video on a browser from the same machine? the webpage contains:

<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
<title>Access to this site is blocked</title>
<link rel="stylesheet" href="/en/Default/master.css" type="text/css">

it seems that you have the access blocked.

shoaib-s · 2014-04-02T12:33:30Z

No, I can't.
I didn't check that.
Access to this page is blocked and that's why I am seeing this error.

jaimeMF · 2014-04-02T18:58:23Z

Since the problem is not in youtube-dl itself, I'm closing the issue.

phihag · 2014-04-03T03:29:44Z

Reopening, we should generate a helpful error message.

phihag · 2014-04-03T04:15:06Z

I've added a check for Websense censorship. @shoaib1987 Can you update youtube-dl with youtube-dl -U and retry again? It won't work, but you should now get a much better error message. I'd appreciate if you could verify that.

shoaib-s · 2014-04-03T05:57:06Z

Yes, new message seems to be more appropriate.
I verified this.
./youtube-dl -v http://www.ustream.tv/recorded/44902811
[debug] System config: []
[debug] User config: []
[debug] Command-line args: ['-v', 'http://www.ustream.tv/recorded/44902811']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2014.04.03
[debug] Python version 2.7.3 - Linux-3.2.0-23-generic-x86_64-with-LinuxMint-13-maya
[debug] Proxy map: {}
[ustream] 44902811: Downloading webpage
ERROR: Access to URL http://172.20.2.7:15871/cgi-bin/blockpage.cgi?ws-session=755072550 has been blocked by Websense filtering software in your network. Visit http://172.20.2.7:15871/cgi-bin/block_message.cgi?ws-session=755072550 for more details
Traceback (most recent call last):
File "./youtube-dl/youtube_dl/YoutubeDL.py", line 511, in extract_info
ie_result = ie.extract(url)
File "./youtube-dl/youtube_dl/extractor/common.py", line 161, in extract
return self._real_extract(url)
File "./youtube-dl/youtube_dl/extractor/ustream.py", line 31, in _real_extract
webpage = self._download_webpage(url, video_id)
File "./youtube-dl/youtube_dl/extractor/common.py", line 270, in _download_webpage
res = self._download_webpage_handle(url_or_request, video_id, note, errnote, fatal)
File "./youtube-dl/youtube_dl/extractor/common.py", line 264, in _download_webpage_handle
raise ExtractorError(msg, expected=True)
ExtractorError: Access to URL http://172.20.2.7:15871/cgi-bin/blockpage.cgi?ws-session=755072550 has been blocked by Websense filtering software in your network. Visit http://172.20.2.7:15871/cgi-bin/block_message.cgi?ws-session=755072550 for more details

jaimeMF closed this Apr 2, 2014

phihag reopened this Apr 3, 2014

phihag closed this in 2410c43 Apr 3, 2014

ytdl-org / youtube-dl

unable to download videos from ustreamtv #2670

unable to download videos from ustreamtv #2670

shirishag75 commented Apr 2, 2014

jaimeMF commented Apr 2, 2014

shoaib-s commented Apr 2, 2014

shoaib-s commented Apr 2, 2014

phihag commented Apr 2, 2014

shirishag75 commented Apr 2, 2014

shoaib-s commented Apr 2, 2014

jaimeMF commented Apr 2, 2014

shoaib-s commented Apr 2, 2014

jaimeMF commented Apr 2, 2014

phihag commented Apr 3, 2014

phihag commented Apr 3, 2014

shoaib-s commented Apr 3, 2014

ytdl-org / youtube-dl

Join GitHub today

GitHub is where the world builds software

unable to download videos from ustreamtv #2670

unable to download videos from ustreamtv #2670

Comments

shirishag75 commented Apr 2, 2014

jaimeMF commented Apr 2, 2014

shoaib-s commented Apr 2, 2014

shoaib-s commented Apr 2, 2014

phihag commented Apr 2, 2014

shirishag75 commented Apr 2, 2014

shoaib-s commented Apr 2, 2014

jaimeMF commented Apr 2, 2014

shoaib-s commented Apr 2, 2014

jaimeMF commented Apr 2, 2014

phihag commented Apr 3, 2014

phihag commented Apr 3, 2014

shoaib-s commented Apr 3, 2014

Essential cookies

Always active

Analytics cookies