Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[watchdisneychannel.go.com] HTTP error 403 Forbidden (on short) #12087

Closed
RuneMagle opened this issue Feb 11, 2017 · 9 comments
Closed

[watchdisneychannel.go.com] HTTP error 403 Forbidden (on short) #12087

RuneMagle opened this issue Feb 11, 2017 · 9 comments

Comments

@RuneMagle
Copy link

@RuneMagle RuneMagle commented Feb 11, 2017

  • I've verified and I assure that I'm running youtube-dl 2017.02.11
  • At least skimmed through README and most notably FAQ and BUGS sections
  • Searched the bugtracker for similar issues including closed ones

What is the purpose of your issue?

  • Bug report (encountered problems with youtube-dl)
  • Site support request (request for adding support for a new site)
  • Feature request (request for a new functionality)
  • Question
  • Other

C:\Users\Desktop\youtube-dl>youtube-dl.exe -f best --all-subs http://watchdisneychannel.go.com/disney-mickey-mouse/video/vdka0_rk02savy/no-reservation -v
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-f', 'best', '--all-subs', 'http://watchdisneychannel.go.com/disney-mickey-mouse/video/vdka0_rk02savy/no-reservation', '-v']
[debug] Encodings: locale cp1252, fs mbcs, out cp850, pref cp1252
[debug] youtube-dl version 2017.02.11
[debug] Python version 3.4.4 - Windows-10-10.0.14393
[debug] exe versions: ffmpeg N-83034-gf48b6b8, ffprobe N-83096-g6596b34
[debug] Proxy map: {}
[Go] 0_rk02savy: Downloading JSON metadata
[Go] 0_rk02savy: Downloading m3u8 information
[info] Writing video subtitles to: No Reservation-0_rk02savy.en-us.ttml
[debug] Invoking downloader on 'http://content-ause1.uplynk.com/4d26ef94f5b847e5b11924f6e8c39aa3/k.m3u8'
[download] Destination: No Reservation-0_rk02savy.mp4
[debug] ffmpeg command line: ffmpeg -y -headers 'Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
Accept-Language: en-us,en;q=0.5
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:10.0) Gecko/20150101 Firefox/47.0 (Chrome)
Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
Accept-Encoding: gzip, deflate
' -i http://content-ause1.uplynk.com/4d26ef94f5b847e5b11924f6e8c39aa3/k.m3u8 -c copy -f mp4 -bsf:a aac_adtstoasc 'file:No Reservation-0_rk02savy.mp4.part'
ffmpeg version N-83034-gf48b6b8 Copyright (c) 2000-2017 the FFmpeg developers
  built with gcc 5.4.0 (GCC)
  configuration: --enable-gpl --enable-version3 --enable-dxva2 --enable-libmfx --enable-nvenc --enable-avisynth --enable-bzlib --enable-fontconfig --enable-frei0r --enable-gnutls --enable-iconv --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libfreetype --enable-libgme --enable-libgsm --enable-libilbc --enable-libmodplug --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenh264 --enable-libopenjpeg --enable-libopus --enable-librtmp --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvo-amrwbenc --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxavs --enable-libxvid --enable-libzimg --enable-lzma --enable-decklink --enable-zlib
  libavutil      55. 43.100 / 55. 43.100
  libavcodec     57. 71.100 / 57. 71.100
  libavformat    57. 62.100 / 57. 62.100
  libavdevice    57.  2.100 / 57.  2.100
  libavfilter     6. 68.100 /  6. 68.100
  libswscale      4.  3.101 /  4.  3.101
  libswresample   2.  4.100 /  2.  4.100
  libpostproc    54.  2.100 / 54.  2.100
[https @ 00000000006ad960] HTTP error 403 Forbidden
Unable to open key file https://content-ause1.uplynk.com/check2?b=4d26ef94f5b847e5b11924f6e8c39aa3&v=4d26ef94f5b847e5b11924f6e8c39aa3&r=k
[crypto @ 00000000006aeec0] Unable to open resource: http://stg-ec-east-u.uplynk.com/slices/4d2/21885d134fa441488df8e1d7acee8c66/4d26ef94f5b847e5b11924f6e8c39aa3/K00000005.ts?x=0&si=0
[hls,applehttp @ 00000000006c24a0] Failed to open segment of playlist 0
[hls,applehttp @ 00000000006c24a0] Error when loading first segment 'http://stg-ec-east-u.uplynk.com/slices/4d2/21885d134fa441488df8e1d7acee8c66/4d26ef94f5b847e5b11924f6e8c39aa3/K00000000.ts?x=0&si=0'
http://content-ause1.uplynk.com/4d26ef94f5b847e5b11924f6e8c39aa3/k.m3u8: Invalid data found when processing input


ERROR: ffmpeg exited with code 1
  File "__main__.py", line 19, in <module>
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp9b6x_5wr\build\youtube_dl\__init__.py", line 452, in main
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp9b6x_5wr\build\youtube_dl\__init__.py", line 442, in _real_main
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp9b6x_5wr\build\youtube_dl\YoutubeDL.py", line 1796, in download
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp9b6x_5wr\build\youtube_dl\YoutubeDL.py", line 707, in extract_info
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp9b6x_5wr\build\youtube_dl\YoutubeDL.py", line 753, in process_ie_result
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp9b6x_5wr\build\youtube_dl\YoutubeDL.py", line 1440, in process_video_result
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp9b6x_5wr\build\youtube_dl\YoutubeDL.py", line 1704, in process_info
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp9b6x_5wr\build\youtube_dl\YoutubeDL.py", line 1646, in dl
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp9b6x_5wr\build\youtube_dl\downloader\common.py", line 353, in download
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp9b6x_5wr\build\youtube_dl\downloader\external.py", line 44, in real_download
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp9b6x_5wr\build\youtube_dl\downloader\common.py", line 162, in report_error
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp9b6x_5wr\build\youtube_dl\YoutubeDL.py", line 570, in report_error
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp9b6x_5wr\build\youtube_dl\YoutubeDL.py", line 532, in trouble
...
<end of log>


Description of my issue

Hi, I found out when trying to get this video short, I get this error code. But when I download another video short, it downloads but the video is not full. The video that downloads is a black screen in the start, and not full ending. I don't get the difference between this video, and the other video. (videos listed above)

@gkoelln
Copy link
Contributor

@gkoelln gkoelln commented Feb 12, 2017

I found the difference. It's a video_type of "sf" vs. a video_type of "lf." I'm not sure what that means, but in go.py, if Line 81 is commented out or removed and the indents are reduced on subsequent lines, the video downloads.

@remitamine
Copy link
Collaborator

@remitamine remitamine commented Feb 12, 2017

sf -> short form
lf -> long form

but in go.py, if Line 81 is commented out or removed and the indents are reduced on subsequent lines, the video downloads.

the consequence of signing every url is the loss of quality and every video will be geo-restricted, it will be better to find a rule to sign only the urls that need it.

@RuneMagle
Copy link
Author

@RuneMagle RuneMagle commented Feb 12, 2017

I don't understand it. But, if you know fix, it's cool ;)

@gkoelln
Copy link
Contributor

@gkoelln gkoelln commented Feb 12, 2017

Which videos would not need signing? How would that degrade the quality? And if a video is geo-restricted, would one even be able to extract whether it's short form or long form anyway? Apparently, I still have a lot to learn.

@RuneMagle
Copy link
Author

@RuneMagle RuneMagle commented Feb 12, 2017

The links I put here does not require login.

@remitamine
Copy link
Collaborator

@remitamine remitamine commented Feb 12, 2017

Which videos would not need signing? How would that degrade the quality?

without trying to sign the url:

python __main__.py http://watchdisneychannel.go.com/descendants-wicked-world/video/vdka3670123/face-to-face
[Go] 3670123: Downloading JSON metadata
[Go] 3670123: Downloading m3u8 information
WARNING: ar subtitles not available for 3670123
WARNING: en subtitles not available for 3670123
[hlsnative] Downloading m3u8 manifest
[hlsnative] Total fragments: 38
[download] Destination: Episode 30 - Face to Face-3670123.mp4
[download]   1.6% of ~63.14MiB at 525.42KiB/s ETA 03:13
python __main__.py -F http://watchdisneychannel.go.com/descendants-wicked-world/video/vdka3670123/face-to-face
[Go] 3670123: Downloading JSON metadata
[Go] 3670123: Downloading m3u8 information
WARNING: ar subtitles not available for 3670123
WARNING: en subtitles not available for 3670123
[info] Available formats for 3670123:
format code                     extension  resolution note
ULNK-meta                       mp4        multiple   Quality selection URL 
MP4-0                           mp4        unknown    
MP4-1                           mp4        unknown    
ULNK-132                        mp4        192x108     132k , avc1.42000b, 15.0fps, mp4a.40.5
ULNK-239                        mp4        288x162     239k , avc1.42000c, 15.0fps, mp4a.40.5
ULNK-English_-_Spoken_Language  mp4        448x252     441k , avc1.420015, 30.0fps, mp4a.40.5
ULNK-752                        mp4        768x432     752k , avc1.4d001e, 30.0fps, mp4a.40.5
ULNK-1197                       mp4        992x558    1197k , avc1.4d001f, 30.0fps, mp4a.40.5
ULNK-1672                       mp4        1056x594   1672k , avc1.4d001f, 30.0fps, mp4a.40.5
ULNK-2073                       mp4        1088x612   2073k , avc1.4d001f, 30.0fps, mp4a.40.5
ULNK-2577                       mp4        1152x648   2577k , avc1.4d001f, 30.0fps, mp4a.40.5
ULNK-3570                       mp4        1280x720   3570k , avc1.64001f, 30.0fps, mp4a.40.5
ULNK-5178                       mp4        1920x1080  5178k , avc1.640028, 30.0fps, mp4a.40.5 (best)

trying to sign the url:

[amine@amine youtube_dl]$ python __main__.py http://watchdisneychannel.go.com/descendants-wicked-world/video/vdka3670123/face-to-face
[Go] 3670123: Downloading JSON metadata
[Go] 3670123: Downloading JSON metadata
ERROR: Go said: 1002:You appear to be outside the United States or its territories. Due to international rights agreements, we only offer this video to viewers located within the United States and its territories.

no 1080p for signed url:

python __main__.py -F http://watchdisneychannel.go.com/descendants-wicked-world/video/vdka3670123/face-to-face
[Go] 3670123: Downloading JSON metadata
[Go] 3670123: Downloading JSON metadata
[Go] 3670123: Downloading m3u8 information
WARNING: ar subtitles not available for 3670123
WARNING: en subtitles not available for 3670123
[info] Available formats for 3670123:
format code                     extension  resolution note
ULNK-meta                       mp4        multiple   Quality selection URL 
MP4-0                           mp4        unknown    
MP4-1                           mp4        unknown    
ULNK-132                        mp4        192x108     132k , avc1.42000b, 15.0fps, mp4a.40.5
ULNK-239                        mp4        288x162     239k , avc1.42000c, 15.0fps, mp4a.40.5
ULNK-441                        mp4        448x252     441k , avc1.420015, 30.0fps, mp4a.40.5
ULNK-752                        mp4        768x432     752k , avc1.4d001e, 30.0fps, mp4a.40.5
ULNK-1197                       mp4        992x558    1197k , avc1.4d001f, 30.0fps, mp4a.40.5
ULNK-1672                       mp4        1056x594   1672k , avc1.4d001f, 30.0fps, mp4a.40.5
ULNK-2073                       mp4        1088x612   2073k , avc1.4d001f, 30.0fps, mp4a.40.5
ULNK-2577                       mp4        1152x648   2577k , avc1.4d001f, 30.0fps, mp4a.40.5
ULNK-English_-_Spoken_Language  mp4        1280x720   3570k , avc1.64001f, 30.0fps, mp4a.40.5 (best)

And if a video is geo-restricted, would one even be able to extract whether it's short form or long form anyway?

only the api endpoint for signing the url is geo-restricted.

@RuneMagle
Copy link
Author

@RuneMagle RuneMagle commented Feb 12, 2017

I don't know so much about it. All I know is, there have never been 1080p on the locked (login required videos), there have only been 720p. I just first realized that 1080p was available for shorts.

@remitamine
Copy link
Collaborator

@remitamine remitamine commented Feb 12, 2017

actually 1080p is also available for locked videos but it's restricted by the signed url(i guess it is served only for tv apps).

@gkoelln
Copy link
Contributor

@gkoelln gkoelln commented Feb 13, 2017

Thanks for the clarification, @remitamine . When you said "loss of quality," you were referring to availability, not degradation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
3 participants
You can’t perform that action at this time.