youtube-dl hangs when requesting a myspace URL

[phihag]

youtube-dl just hangs after:

youtube-dl  https://myspace.com/spiderbags/music/song/bad-complexion-39008443-41298278 --verbose 
[debug] System config: []
[debug] User config: []
[debug] Command-line args: ['https://myspace.com/spiderbags/music/song/bad-complexion-39008443-41298278', '--verbose']
[debug] youtube-dl version 2013.12.23.4
[debug] Git HEAD: e6812ac
[debug] Python version 2.7.6 - Linux-3.4-trunk-amd64-x86_64-with-debian-jessie-sid
[debug] Proxy map: {}

[orangeoval]

The issue persists in the most recent update (2014.01.08), which is to be expected given that this issue is still open, but some code change caused the process to dump an additional line in the verbose output: [generic] bleed-for-you-39008451-41298286: Requesting header. I am not sure if it is getting stuck in the same spot, which would make this point moot, but I figured more information is better than less. Full output:

[~/Music/YouTubeDL]: youtube-dl https://myspace.com/spiderbags/music/song/bleed-for-you-39008451-41298286 --verbose
[debug] System config: []
[debug] User config: []
[debug] Command-line args: ['https://myspace.com/spiderbags/music/song/bleed-for-you-39008451-41298286', '--verbose']
[debug] Encodings: locale 'UTF-8', fs 'utf-8', out 'UTF-8', pref: 'UTF-8'
[debug] youtube-dl version 2014.01.08
[debug] Python version 2.7.1 - Darwin-11.4.2-x86_64-i386-64bit
[debug] Proxy map: {}
[generic] bleed-for-you-39008451-41298286: Requesting header

For what it's worth, this requesting header line is not included in the verbose output when successfully downloading a youtube file, for example. For a youtube file, the output goes from "[debug] Proxy map: {}" to "[youtube] Setting language", with no instance of requesting header anywhere after that.

Thanks again for the awesome program!

[phihag]

I've looked into it; this is a bug of myspace, who apparently hang indefinitly upon receiving an HTTP HEAD request. One can reproduce that with

curl -I https://myspace.com/spiderbags/music/song/bleed-for-you-39008451-41298286

I added the extra line ([generic] bleed-for-you-39008451-41298286: Requesting header) intentionally in order to clarify that some network request was going on. Note the [generic], which indicates that this URL is not matched by our myspace extractor. I'll try to fix the myspace extractor.

[orangeoval]

Thanks for the detailed explanation, makes perfect sense. I should have thought to try the curl request myself, but now I know for the future.

[phihag]

Ok, I can make our MySpace extractor match that URL, but there seems to be a different infrastructure. Problem is, I haven't found out how to actually play music in the web interface - both the traditional as well as the mobile one. Can you tell me (screenshots appreciated) how one can make something play on https://myspace.com/spiderbags/music/song/bleed-for-you-39008451-41298286 ?

[jaimeMF]

I couldn't play that song, but https://myspace.com/spiderbags/music/song/darkness-in-my-heart-39008454-27041242 and others can be played without problems.
@orangeoval If you can play it and youtube-dl can't download it, please report it.

[orangeoval]

I can play it and all other songs on that page, and none of them download via youtube-dl. Instead, they all hit the [generic] requesting header event that I mentioned above and then hang. From that direct link provided, there are three methods of playing the song, which are annotated in the first screen shot below. The second screen shot proves that those methods work by highlighting that the song's time track bar is indeed active, as the song has been playing for 8 seconds...

I am doing this in Firefox 26.0 on OS X 10.7.5

[orangeoval]

@jaimeMF 's most recent comment: I can play that song as well, but still cannot download using that link. Were you able to use that link (https://myspace.com/spiderbags/music/song/darkness-in-my-heart-39008454-27041242) and successfully pull the file?

[jaimeMF]

It works fine for me (and we use it as a test for the extractor without problems), you have to use the version from git, since there isn't a new version yet. If you don't feel confident, just wait for the next release.
I don't see the play button on https://myspace.com/spiderbags/music/song/bad-complexion-39008443-41298278, I don't know why, other songs work fine.

I forgot to say, thanks for the report!

[orangeoval]

I look forward to the next release. Thanks everyone for all the help and the good work you're doing!

[phihag]

youtube-dl 2014.01.20 has just been released and should fix this problem. Type youtube-dl -U to update.

[orangeoval]

I just now got around to testing this and it works great! I just wanted to drop a few notes for anyone who is interested. Pulling from myspace (at least in my example) requires rtmpdump, which the --verbose flag revealed to me more or less:

ERROR: RTMP download detected but "rtmpdump" could not be run

With homebrew installed, a simple "brew install rtmpdump" did the trick (or you can download from http://rtmpdump.mplayerhq.hu/). However, running youtube-dl against the myspace URL with no flags resulted in a .flv file, which is not ideal (as we are extracting audio here). Even in the .flv format, it wouldn't play in VLC, so something wasn't quite jiving there. Throwing the --audio-format does not work in this scenario, as the file is naturally in video (flv) format. However, throwing the -x flag does resolve the issue by post-processing the .flv file into a friendly and playable .m4a format. For example:

youtube-dl -x https://myspace.com/spiderbags/music/song/long-white-desert-rose-54913155-59479495

This -x method implies an ffmpeg dependency, which can also be acquired easily through homebrew (or from ffmpeg.org): brew install ffmpeg

THANKS AGAIN!