Ooyala download issue (mobile player JS for unknown device)

[matthewrees]

Hi there

I've never viewed anything on Ooyala before, but I am interested in a particular video that only seems to be hosted there (currently). Seeing that youtube-dl lists Ooyala as a supported site I thought I would give it a shot.

Below are the details of the video I am trying to grab as well as verbose output from youtube-dl and the version:

Version: 2014.08.29
URL: http://www.capitalxtra.com/news/above-and-beyond-dj-set-sw4-2014/
Specific Ooyala URL: http://player.ooyala.com/player/ipad/5iNDh0bzpvu_8-UHX6cbPkj7Grobevne.m3u8?js=1

Output:
youtube-dl -v http://www.capitalxtra.com/news/above-and-beyond-dj-set-sw4-2014/
[debug] System config: []
[debug] User config: []
[debug] Command-line args: ['-v', 'http://www.capitalxtra.com/news/above-and-beyond-dj-set-sw4-2014/']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2014.08.29
[debug] Python version 2.7.6 - Linux-3.13.0-34-generic-x86_64-with-Ubuntu-14.04-trusty
[debug] Proxy map: {}
[generic] above-and-beyond-dj-set-sw4-2014: Requesting header
WARNING: Falling back on generic information extractor.
[generic] above-and-beyond-dj-set-sw4-2014: Downloading webpage
[generic] above-and-beyond-dj-set-sw4-2014: Extracting information
[Ooyala] 5iNDh0bzpvu_8-UHX6cbPkj7Grobevne: Downloading webpage
[Ooyala] 5iNDh0bzpvu_8-UHX6cbPkj7Grobevne: Downloading mobile player JS for unknown device
[debug] Invoking downloader on u'http://player.ooyala.com/player/ipad/5iNDh0bzpvu_8-UHX6cbPkj7Grobevne.m3u8?js=1'
[download] Destination: Above & Beyond Full DJ Set At South West Four Festival 2014-5iNDh0bzpvu_8-UHX6cbPkj7Grobevne.mp4
avconv version 9.16-6:9.16-0ubuntu0.14.04.1, Copyright (c) 2000-2014 the Libav developers
built on Aug 10 2014 18:16:02 with gcc 4.8 (Ubuntu 4.8.2-19ubuntu1)
[hls,applehttp @ 0x1457fe0] max_analyze_duration reached
Input #0, hls,applehttp, from 'http://player.ooyala.com/player/ipad/5iNDh0bzpvu_8-UHX6cbPkj7Grobevne.m3u8?js=1':
Duration: 01:20:38.00, bitrate: 0 kb/s
Stream #0.0: Video: h264, 90k tbn
Metadata:
variant_bitrate : 1555000
Stream #0.1: Audio: aac, 0 channels, fltp
Metadata:
variant_bitrate : 1555000
Stream #0.2: Audio: aac, 44100 Hz, stereo, fltp
Metadata:
variant_bitrate : 56000
Stream #0.3: Video: h264, 90k tbn
Metadata:
variant_bitrate : 543000
Stream #0.4: Audio: aac, 0 channels, fltp
Metadata:
variant_bitrate : 543000
Stream #0.5: Video: h264, 90k tbn
Metadata:
variant_bitrate : 890000
Stream #0.6: Audio: aac, 0 channels, fltp
Metadata:
variant_bitrate : 890000
Stream #0.7: Video: h264, 90k tbn
Metadata:
variant_bitrate : 2244000
Stream #0.8: Audio: aac, 0 channels, fltp
Metadata:
variant_bitrate : 2244000
Stream #0.9: Video: h264, 90k tbn
Metadata:
variant_bitrate : 2934000
Stream #0.10: Audio: aac, 0 channels, fltp
Metadata:
variant_bitrate : 2934000
Stream #0.11: Video: h264, 90k tbn
Metadata:
variant_bitrate : 5237000
Stream #0.12: Audio: aac, 0 channels, fltp
Metadata:
variant_bitrate : 5237000
Output #0, mp4, to 'Above & Beyond Full DJ Set At South West Four Festival 2014-5iNDh0bzpvu_8-UHX6cbPkj7Grobevne.mp4.part':
Metadata:
encoder : Lavf54.20.4
Stream #0.0: Audio: aac, 44100 Hz, stereo
Metadata:
variant_bitrate : 56000
Stream mapping:
Stream #0:2 -> #0:0 (copy)
Press ctrl-c to stop encoding
No longer receiving variant 6bitrate= 58.9kbits/s
[mpegts @ 0x30029e0] PES packet size mismatch
No longer receiving variant 0bitrate= 58.9kbits/s
[hls,applehttp @ 0x1457fe0] No longer receiving variant 2
[hls,applehttp @ 0x1457fe0] No longer receiving variant 3
[hls,applehttp @ 0x1457fe0] No longer receiving variant 4
[hls,applehttp @ 0x1457fe0] No longer receiving variant 5
size= 37761kB time=4847.94 bitrate= 63.8kbits/s
video:0kB audio:36281kB global headers:0kB muxing overhead 4.081416%
[avconv] 38667601 bytes

There seem to be two areas of interest, the first being that Ooyala's JS is defaulting to delivering an iPad specific stream as youtube-dl is an "unknown device" and secondly the avconv output regarding "PES packet size mismatch" and "No longer receiving variant X".

Any help or ideas would be appreciated, and if you need any further info or testing please let me know.

Thanks!

[matthewrees]

Hi there.

So it would seem it was an issue with avconv (or simply the version of avconv) as when using the latest git version of ffmpeg the download of the stream completed successfully:

youtube-dl --prefer-ffmpeg -v http://www.capitalxtra.com/news/above-and-beyond-dj-set-sw4-2014/
[debug] System config: []
[debug] User config: []
[debug] Command-line args: ['--prefer-ffmpeg', '-v', 'http://www.capitalxtra.com/news/above-and-beyond-dj-set-sw4-2014/']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2014.09.01.2
[debug] Python version 2.7.6 - Linux-3.16.1-031601-generic-x86_64-with-Ubuntu-14.04-trusty
[debug] Proxy map: {}
[generic] above-and-beyond-dj-set-sw4-2014: Requesting header
WARNING: Falling back on generic information extractor.
[generic] above-and-beyond-dj-set-sw4-2014: Downloading webpage
[generic] above-and-beyond-dj-set-sw4-2014: Extracting information
[Ooyala] 5iNDh0bzpvu_8-UHX6cbPkj7Grobevne: Downloading webpage
[Ooyala] 5iNDh0bzpvu_8-UHX6cbPkj7Grobevne: Downloading mobile player JS for unknown device
[debug] Invoking downloader on u'http://player.ooyala.com/player/ipad/5iNDh0bzpvu_8-UHX6cbPkj7Grobevne.m3u8?js=1'
[download] Destination: Above & Beyond Full DJ Set At South West Four Festival 2014-5iNDh0bzpvu_8-UHX6cbPkj7Grobevne.mp4
ffmpeg version 2.3.git Copyright (c) 2000-2014 the FFmpeg developers
built on Sep 3 2014 11:22:11 with gcc 4.8 (Ubuntu 4.8.2-19ubuntu1)
configuration: --prefix=/home/matthew/ffmpeg_build --extra-cflags=-I/home/matthew/ffmpeg_build/include --extra-ldflags=-L/home/matthew/ffmpeg_build/lib --bindir=/home/matthew/bin --enable-gpl --enable-libass --enable-libfdk-aac --enable-libfreetype --enable-libmp3lame --enable-libopus --enable-libtheora --enable-libvorbis --enable-libvpx --enable-libx264 --enable-nonfree --enable-x11grab
libavutil 54. 7.100 / 54. 7.100
libavcodec 56. 1.100 / 56. 1.100
libavformat 56. 3.100 / 56. 3.100
libavdevice 56. 0.100 / 56. 0.100
libavfilter 5. 0.103 / 5. 0.103
libswscale 3. 0.100 / 3. 0.100
libswresample 1. 1.100 / 1. 1.100
libpostproc 53. 0.100 / 53. 0.100
Input #0, hls,applehttp, from 'http://player.ooyala.com/player/ipad/5iNDh0bzpvu_8-UHX6cbPkj7Grobevne.m3u8?js=1':
Duration: 01:20:38.00, start: 0.000000, bitrate: 0 kb/s
Program 0
Metadata:
variant_bitrate : 1555000
Stream #0:0: Video: h264 (Constrained Baseline) ([27][0][0][0] / 0x001B), yuv420p, 1280x720 [SAR 1:1 DAR 16:9], 25 fps, 25 tbr, 90k tbn, 50 tbc
Metadata:
variant_bitrate : 1555000
Stream #0:1: Audio: aac ([15][0][0][0] / 0x000F), 44100 Hz, stereo, fltp, 161 kb/s
Metadata:
variant_bitrate : 1555000
Program 1
Metadata:
variant_bitrate : 56000
Stream #0:2: Audio: aac, 44100 Hz, stereo, fltp, 65 kb/s
Metadata:
variant_bitrate : 56000
Program 2
Metadata:
variant_bitrate : 543000
Stream #0:3: Video: h264 (Constrained Baseline) ([27][0][0][0] / 0x001B), yuv420p, 320x180 [SAR 1:1 DAR 16:9], 25 fps, 25 tbr, 90k tbn, 50 tbc
Metadata:
variant_bitrate : 543000
Stream #0:4: Audio: aac ([15][0][0][0] / 0x000F), 44100 Hz, stereo, fltp, 161 kb/s
Metadata:
variant_bitrate : 543000
Program 3
Metadata:
variant_bitrate : 890000
Stream #0:5: Video: h264 (Constrained Baseline) ([27][0][0][0] / 0x001B), yuv420p, 640x360 [SAR 1:1 DAR 16:9], 25 fps, 25 tbr, 90k tbn, 50 tbc
Metadata:
variant_bitrate : 890000
Stream #0:6: Audio: aac ([15][0][0][0] / 0x000F), 44100 Hz, stereo, fltp, 161 kb/s
Metadata:
variant_bitrate : 890000
Program 4
Metadata:
variant_bitrate : 2244000
Stream #0:7: Video: h264 (Constrained Baseline) ([27][0][0][0] / 0x001B), yuv420p, 1280x720 [SAR 1:1 DAR 16:9], 25 fps, 25 tbr, 90k tbn, 50 tbc
Metadata:
variant_bitrate : 2244000
Stream #0:8: Audio: aac ([15][0][0][0] / 0x000F), 44100 Hz, stereo, fltp, 161 kb/s
Metadata:
variant_bitrate : 2244000
Program 5
Metadata:
variant_bitrate : 2934000
Stream #0:9: Video: h264 (Constrained Baseline) ([27][0][0][0] / 0x001B), yuv420p, 1280x720 [SAR 1:1 DAR 16:9], 25 fps, 25 tbr, 90k tbn, 50 tbc
Metadata:
variant_bitrate : 2934000
Stream #0:10: Audio: aac ([15][0][0][0] / 0x000F), 44100 Hz, stereo, fltp, 161 kb/s
Metadata:
variant_bitrate : 2934000
Program 6
Metadata:
variant_bitrate : 5237000
Stream #0:11: Video: h264 (Constrained Baseline) ([27][0][0][0] / 0x001B), yuv420p, 1280x720 [SAR 1:1 DAR 16:9], 25 fps, 25 tbr, 90k tbn, 50 tbc
Metadata:
variant_bitrate : 5237000
Stream #0:12: Audio: aac ([15][0][0][0] / 0x000F), 44100 Hz, stereo, fltp, 161 kb/s
Metadata:
variant_bitrate : 5237000
Output #0, mp4, to 'Above & Beyond Full DJ Set At South West Four Festival 2014-5iNDh0bzpvu_8-UHX6cbPkj7Grobevne.mp4.part':
Metadata:
encoder : Lavf56.3.100
Stream #0:0: Video: h264 ([33][0][0][0] / 0x0021), yuv420p, 1280x720 [SAR 1:1 DAR 16:9], q=2-31, 25 fps, 90k tbn, 90k tbc
Metadata:
variant_bitrate : 1555000
Stream #0:1: Audio: aac ([64][0][0][0] / 0x0040), 44100 Hz, stereo, 161 kb/s
Metadata:
variant_bitrate : 1555000
Stream mapping:
Stream #0:0 -> #0:0 (copy)
Stream #0:1 -> #0:1 (copy)
Press [q] to stop, [?] for help
[hls,applehttp @ 0x33b0c20] No longer receiving playlist 1
[hls,applehttp @ 0x33b0c20] No longer receiving playlist 2
[hls,applehttp @ 0x33b0c20] No longer receiving playlist 3
[hls,applehttp @ 0x33b0c20] No longer receiving playlist 4
[hls,applehttp @ 0x33b0c20] No longer receiving playlist 5
[hls,applehttp @ 0x33b0c20] No longer receiving playlist 6
frame=120961 fps=255 q=-1.0 Lsize= 768272kB time=01:20:38.45 bitrate=1300.8kbits/s
video:689654kB audio:75596kB subtitle:0kB other streams:0kB global headers:1kB muxing overhead: 0.395010%
[ffmpeg] 786710811 bytes

Thanks!