[myspace] Unable to download webpage: HTTP Error 403

[pricejn2]

MySpace test url's are failing (just noticed it today on 2014.01.27.1)

youtube-dl --verbose https://myspace.com/coldplay/video/viva-la-vida/100008689
[debug] System config: []
[debug] User config: []
[debug] Command-line args: ['--verbose', 'https://myspace.com/coldplay/video/viva-la-vida/100008689']
[debug] Encodings: locale 'UTF-8', fs 'UTF-8', out 'UTF-8', pref: 'UTF-8'
[debug] youtube-dl version 2014.01.27.1
[debug] Python version 2.7.3 - Linux-3.2.0-4-amd64-x86_64-with-debian-7.3
[debug] Proxy map: {}
[MySpace] 100008689: Downloading webpage
ERROR: Unable to download webpage: HTTP Error 403: Forbidden; please report this issue on https://yt-dl.org/bug . Be sure to call youtube-dl with the --verbose flag and include its complete output. Make sure you are using the latest version; type  youtube-dl -U  to update.
  File "/usr/local/lib/python2.7/dist-packages/youtube_dl/extractor/common.py", line 191, in _request_webpage
    return self._downloader.urlopen(url_or_request)
  File "/usr/local/lib/python2.7/dist-packages/youtube_dl/YoutubeDL.py", line 1157, in urlopen
    return self._opener.open(req)
  File "/usr/lib/python2.7/urllib2.py", line 407, in open
    response = meth(req, response)
  File "/usr/lib/python2.7/urllib2.py", line 520, in http_response
    'http', request, response, code, msg, hdrs)
  File "/usr/lib/python2.7/urllib2.py", line 445, in error
    return self._call_chain(*args)
  File "/usr/lib/python2.7/urllib2.py", line 379, in _call_chain
    result = func(*args)
  File "/usr/lib/python2.7/urllib2.py", line 528, in http_error_default
    raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)

[jaimeMF]

I can't open the page on Firefox, there seems to be a problem with the certificate. On python 3.3 I get Unable to download webpage: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:550)>, but on 2.7 it seems to work.

[pricejn2]

Same 403 issue for me with the other test url https://myspace.com/spiderbags/music/song/darkness-in-my-heart-39008454-27041242

[phihag]

The song is blocked in the US, but works from Europe. We should add a fitting error message.

[pricejn2]

@phihag -- I'm able to browse and listen to the song in the US. I've not been able to get a single myspace song/video download working today, however.

[yasoob]

I got it working in Asia as well. @pricejn2 can you check again and reply back?

[pricejn2]

I tried a couple of different servers and got the same result:

youtube-dl https://myspace.com/spiderbags/music/song/darkness-in-my-heart-39008454-41298289 --print-traffic
[MySpace] 39008454: Downloading webpage
send: u'GET /spiderbags/music/song/darkness-in-my-heart-39008454-41298289 HTTP/1.1\r\nAccept-Language: en-us,en;q=0.5\r\nAccept-Encoding: gzip, deflate\r\nConnection: close\r\nAccept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8\r\nUser-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:10.0) Gecko/20100101 Firefox/10.0 (Chrome)\r\nAccept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7\r\nHost: myspace.com\r\n\r\n'
reply: 'HTTP/1.1 403 Forbidden\r\n'
header: X-Powered-By: Express
header: Date: Mon, 03 Feb 2014 22:00:53 GMT
header: Connection: keep-alive
header: Transfer-Encoding: chunked
ERROR: Unable to download webpage: HTTP Error 403: Forbidden; please report this issue on https://yt-dl.org/bug . Be sure to call youtube-dl with the --verbose flag and include its complete output. Make sure you are using the latest version; type  youtube-dl -U  to update.

i'm wondering if its a server config issue but haven't figure out a good way to debug. i can ping myspace.com and fms.ec-music.myspacecdn.com. curl -I https://myspace.com/spiderbags/music/song/darkness-in-my-heart-39008454-41298289 just hangs. (EDIT curl hanging against myspace url's is a known issue #2040)

[phihag]

yes, try curl -i https://myspace.com/spiderbags/music/song/darkness-in-my-heart-39008454-41298289. (Lower-case i) Does that hang too?

[pricejn2]

same 403 as with youtube-dl... back to the drawing board.

curl -i https://myspace.com/spiderbags/music/song/darkness-in-my-heart-39008454-41298289
HTTP/1.1 403 Forbidden
X-Powered-By: Express
Date: Tue, 04 Feb 2014 15:04:36 GMT
Connection: keep-alive
Transfer-Encoding: chunked

[pricejn2]

However, rtmpdump connects and downloads successfully when used directly.

rtmpdump --verbose -r rtmpe://fms.ec-music.myspacecdn.com/ -o 'Darkness In My Heart-39008454.flv.part' --playpath mp4:music02/297/57bb887e143f4cbe955b3bab75364ec4/std.m4a --resume --skip 1

[pricejn2]

i'm fairly convinced my ip has been blocked, so closing for now since no one else can dupe the issue.

[pricejn2]

I think something else must be going on here. I've tried with a number of proxy addresses and still have yet to see this work

youtube-dl -s https://myspace.com/coldplay/video/viva-la-vida/100008689 --verbose
[debug] System config: []
[debug] User config: []
[debug] Command-line args: ['-s', 'https://myspace.com/coldplay/video/viva-la-vida/100008689', '--verbose']
[debug] Encodings: locale ANSI_X3.4-1968, fs ANSI_X3.4-1968, out ANSI_X3.4-1968, pref ANSI_X3.4-1968
[debug] youtube-dl version 2014.04.07.4
[debug] Python version 2.7.3 - Linux-3.2.0-4-amd64-x86_64-with-debian-7.4
[debug] Proxy map: {}
[MySpace] 100008689: Downloading webpage
ERROR: Unable to download webpage: HTTP Error 403: Forbidden; please report this issue on https://yt-dl.org/bug . Be sure to call youtube-dl with the --verbose flag and include its complete output. Make sure you are using the latest version; type  youtube-dl -U  to update.
  File "/usr/local/lib/python2.7/dist-packages/youtube_dl/extractor/common.py", line 194, in _request_webpage
    return self._downloader.urlopen(url_or_request)
  File "/usr/local/lib/python2.7/dist-packages/youtube_dl/YoutubeDL.py", line 1211, in urlopen
    return self._opener.open(req, timeout=self._socket_timeout)
  File "/usr/lib/python2.7/urllib2.py", line 407, in open
    response = meth(req, response)
  File "/usr/lib/python2.7/urllib2.py", line 520, in http_response
    'http', request, response, code, msg, hdrs)
  File "/usr/lib/python2.7/urllib2.py", line 445, in error
    return self._call_chain(*args)
  File "/usr/lib/python2.7/urllib2.py", line 379, in _call_chain
    result = func(*args)
  File "/usr/lib/python2.7/urllib2.py", line 528, in http_error_default
    raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)

However, this completes successfully --

rtmpdump --verbose -r "rtmpe://fms-videos.myspacecdn.com/" -W "https://x.myspacecdn.com/new/common/swf/APIPlayer.2.18.0.426.376769da8684473e96dfc50b20bc1b89.swf" -p "https://myspace.com/coldplay/video/viva-la-vida/100008689" -y "flv:videos02/45/94d95d483fb31964134a4db891407e75/vid" -o myspace_100008689.flv