Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

"HTTP Error 401: Unauthorized" if passing in creds or useragent\cookies #13447

Open
jakepbrown27 opened this issue Jun 21, 2017 · 7 comments
Open

Comments

@jakepbrown27
Copy link

@jakepbrown27 jakepbrown27 commented Jun 21, 2017

Please follow the guide below

  • You will be asked some questions and requested to provide some information, please read them carefully and answer honestly
  • Put an x into all the boxes [ ] relevant to your issue (like that [x])
  • Use Preview tab to see how your issue will actually look like

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2017.06.18. If it's not read this FAQ entry and update. Issues with outdated version will be rejected.

  • [X ] I've verified and I assure that I'm running youtube-dl 2017.06.18

Before submitting an issue make sure you have:

  • [X ] At least skimmed through README and most notably FAQ and BUGS sections
  • [X ] Searched the bugtracker for similar issues including closed ones

What is the purpose of your issue?

  • [X ] Bug report (encountered problems with youtube-dl)
  • Site support request (request for adding support for a new site)
  • Feature request (request for a new functionality)
  • [X ] Question
  • Other

The following sections concretize particular purposed issues, you can erase any section (the contents between triple ---) not applicable to your issue


If the purpose of this issue is a bug report, site support request or you are not completely sure provide the full verbose output as follows:

Add -v flag to your command line you run youtube-dl with, copy the whole output and insert it here. It should look similar to one below (replace it with your log inserted between triple ```):

$ youtube-dl -v <your command line>
[debug] System config: []
[debug] User config: []
[debug] Command-line args: [u'-v', u'http://www.youtube.com/watch?v=BaW_jenozKcj']
[debug] Encodings: locale cp1251, fs mbcs, out cp866, pref cp1251
[debug] youtube-dl version 2017.06.18
[debug] Python version 2.7.11 - Windows-2003Server-5.2.3790-SP2
[debug] exe versions: ffmpeg N-75573-g1d0487f, ffprobe N-75573-g1d0487f, rtmpdump 2.4
[debug] Proxy map: {}
...
<end of log>

If the purpose of this issue is a site support request please provide all kinds of example URLs support for which should be included (replace following example URLs by yours):

Note that youtube-dl does not support sites dedicated to copyright infringement. In order for site support request to be accepted all provided example URLs should not violate any copyrights.


Description of your issue, suggested solution and other information

Explanation of your issue in arbitrary form goes here. Please make sure the description is worded well enough to be understood. Provide as much context and examples as possible.
If work on your issue requires account credentials please provide them or explain how one can obtain them.

Hello, I suppose the question portion of this is: is VRV supported\compatible? I did try and perform a .\youtube-dl.exe --list-extractors in which case VRV and VRV:SERIES did show up however I have not had much success.

I am trying to download episodes\video files from VRV [https://vrv.co] For example: [https://vrv.co/series/GR751KNZY/Attack-on-Titan] I have tried just passing in the URL as the content should be viewable with just a regular user account, but also passed in my premium account creds and or a cookies.txt and user agent (I've tried individually as well as different combinations)

`.\youtube-dl.exe : [debug] System config: []
At line:1 char:1

[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-v', 'https://vrv.co/series/GR751KNZY/Attack-on-Titan', '--user-agent', 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like
Gecko) Chrome/58.0.3029.110 Safari/537.36', '--cookies', '.\vrvcookies.txt']
[debug] Encodings: locale cp1252, fs mbcs, out cp1252, pref cp1252
[debug] youtube-dl version 2017.06.18
[debug] Python version 3.4.4 - Windows-10-10.0.15063
[debug] exe versions: none
[debug] Proxy map: {}
[vrv:series] GR751KNZY: Downloading webpage
[vrv:series] GR751KNZY: Downloading resource path JSON metadata
ERROR: Unable to download JSON metadata: HTTP Error 401: Unauthorized (caused by HTTPError()); please report this issue on https://yt-dl.org/bug . Make sure you are using the
latest version; type youtube-dl -U to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp_9wocfhk\build\youtube_dl\extractor\common.py", line 502, in _request_webpage
File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp_9wocfhk\build\youtube_dl\YoutubeDL.py", line 2129, in urlopen
File "C:\Python\Python34\lib\urllib\request.py", line 470, in open
File "C:\Python\Python34\lib\urllib\request.py", line 580, in http_response
File "C:\Python\Python34\lib\urllib\request.py", line 508, in error
File "C:\Python\Python34\lib\urllib\request.py", line 442, in _call_chain
File "C:\Python\Python34\lib\urllib\request.py", line 588, in http_error_default
`

@jakepbrown27
Copy link
Author

@jakepbrown27 jakepbrown27 commented Jun 21, 2017

Hi, so I am largely unfamiliar with the processes reporting\remediation here -- I see the account-needed label, if needed I'll help with a burner account if needed to do work on this.

@dgcurtis
Copy link

@dgcurtis dgcurtis commented Sep 17, 2017

For many of their series, a free account is all that is needed. The series I am trying to download doesn't require a premium account.

@jakepbrown27
Copy link
Author

@jakepbrown27 jakepbrown27 commented Nov 4, 2017

I saw @remitamine say he couldn't repro on another listing - I can also get the listings just fine for the same fairy tail episode. But trying to download the episode doesn't work.

.\youtube-dl.exe -F https://vrv.co/watch/GY8V590JY/Fairy-Tail:The-Fairy-Tail
[vrv] GY8V590JY: Downloading webpage
[vrv] GY8V590JY: Downloading en-US m3u8 information
[vrv] GY8V590JY: Downloading en-US MPD information
[info] Available formats for GY8V590JY:
format code extension resolution note
dash-en-US-f1-a1-x3 m4a audio only [en-US] DASH audio 125k , mp4a.40.2 (44100Hz)
dash-en-US-f4-v1-x3 mp4 640x360 DASH video 537k , avc1.4d401f, video only
dash-en-US-f3-v1-x3 mp4 848x480 DASH video 1150k , avc1.4d401f, video only
dash-en-US-f1-v1-x3 mp4 1280x720 DASH video 1979k , avc1.640032, video only
dash-en-US-f2-v1-x3 mp4 1920x1080 DASH video 4391k , avc1.640032, video only
hls-en-US-662-0 mp4 640x360 [en-US] 662k , avc1.4d401f, mp4a.40.2
hls-en-US-662-1 mp4 640x360 [en-US] 662k , avc1.4d401f, mp4a.40.2
hls-en-US-662-2 mp4 640x360 [en-US] 662k , avc1.4d401f, mp4a.40.2
hls-en-US-1275-0 mp4 848x480 [en-US] 1275k , avc1.4d401f, mp4a.40.2
hls-en-US-1275-1 mp4 848x480 [en-US] 1275k , avc1.4d401f, mp4a.40.2
hls-en-US-1275-2 mp4 848x480 [en-US] 1275k , avc1.4d401f, mp4a.40.2
hls-en-US-2105-0 mp4 1280x720 [en-US] 2105k , avc1.640032, mp4a.40.2
hls-en-US-2105-1 mp4 1280x720 [en-US] 2105k , avc1.640032, mp4a.40.2
hls-en-US-2105-2 mp4 1280x720 [en-US] 2105k , avc1.640032, mp4a.40.2
hls-en-US-4516-0 mp4 1920x1080 [en-US] 4516k , avc1.640032, mp4a.40.2
hls-en-US-4516-1 mp4 1920x1080 [en-US] 4516k , avc1.640032, mp4a.40.2
hls-en-US-4516-2 mp4 1920x1080 [en-US] 4516k , avc1.640032, mp4a.40.2 (best)

PS C:\Users\Desktop\youtubedl> .\youtube-dl.exe https://vrv.co/watch/GY8V590JY/Fairy-Tail:The-Fairy-Tail --ffmpeg-location C:\Users\Desktop\youtubedl\ffmpeg-20170620-ae6f6d4-win64-static\bin\ffmpeg.exe
[vrv] GY8V590JY: Downloading webpage
[vrv] GY8V590JY: Downloading en-US MPD information
.\youtube-dl.exe : Traceback (most recent call last):
At line:1 char:1

  • .\youtube-dl.exe https://vrv.co/watch/GY8V590JY/Fairy-Tail:The-Fairy- ...
  •   + CategoryInfo          : NotSpecified: (Traceback (most recent call last)::String) [], RemoteException
      + FullyQualifiedErrorId : NativeCommandError
    
    File "__main__.py", line 19, in <module>
    File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpk63cqkyt\build\youtube_dl\__init__.py", line 465, in main
    File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpk63cqkyt\build\youtube_dl\__init__.py", line 455, in _real_main
    File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpk63cqkyt\build\youtube_dl\YoutubeDL.py", line 1985, in download
    File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpk63cqkyt\build\youtube_dl\YoutubeDL.py", line 784, in extract_info
    File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpk63cqkyt\build\youtube_dl\extractor\common.py", line 434, in extract
    File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpk63cqkyt\build\youtube_dl\extractor\vrv.py", line 132, in _real_extract
    File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpk63cqkyt\build\youtube_dl\extractor\common.py", line 1753, in _extract_mpd_formats
    File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpk63cqkyt\build\youtube_dl\extractor\common.py", line 1975, in _parse_mpd_formats
    
    

If it isn't supported, it isn't supported and that is fine just hoping for some clarity is all.

@remitamine
Copy link
Collaborator

@remitamine remitamine commented Nov 5, 2017

.\youtube-dl.exe https://vrv.co/watch/GY8V590JY/Fairy-Tail:The-Fairy-Tail
[vrv] GY8V590JY: Downloading webpage
[vrv] GY8V590JY: Downloading en-US m3u8 information
[vrv] GY8V590JY: Downloading en-US MPD information
[dashsegments] Total fragments: 151
[download] Destination: The Fairy Tail-GY8V590JY.fdash-en-US-f2-v1-x3.mp4
[download]   0.6% of ~117.72MiB at 15.95KiB/s ETA 02:12:14
@jakepbrown27
Copy link
Author

@jakepbrown27 jakepbrown27 commented Nov 5, 2017

Seems like it will work for some free content - sometimes that is.

But when it gets to any premium content it no longer does -- I have tried passing in username\password and cookies\user agent, both resulting in the same error below:

youtube-dl.exe -v https://vrv.co/watch/GY9P99J3R/Dofus:My-Buddy-Bashi 
youtube-dl.exe : [debug] System config: []
At line:1 char:1
+ youtube-dl.exe -v https://vrv.co/watch/GY9P99J3R/Dofus:My-Buddy-Bashi
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : NotSpecified: ([debug] System config: []:String) [], RemoteException
    + FullyQualifiedErrorId : NativeCommandError
 
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-v', 'https://vrv.co/watch/GY9P99J3R/Dofus:My-Buddy-Bashi']
[debug] Encodings: locale cp1252, fs mbcs, out cp1252, pref cp1252
[debug] youtube-dl version 2017.10.29
[debug] Python version 3.4.4 - Windows-10-10.0.15063
[debug] exe versions: none
[debug] Proxy map: {}
[vrv] GY9P99J3R: Downloading webpage
ERROR: An extractor error has occurred. (caused by KeyError('streams',)); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest 
version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpk63cqkyt\build\youtube_dl\extractor\common.py", line 434, in extract
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpk63cqkyt\build\youtube_dl\extractor\vrv.py", line 110, in _real_extract
KeyError: 'streams'
Traceback (most recent call last):
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpk63cqkyt\build\youtube_dl\extractor\common.py", line 434, in extract
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpk63cqkyt\build\youtube_dl\extractor\vrv.py", line 110, in _real_extract
KeyError: 'streams'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpk63cqkyt\build\youtube_dl\YoutubeDL.py", line 784, in extract_info
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpk63cqkyt\build\youtube_dl\extractor\common.py", line 447, in extract
youtube_dl.utils.ExtractorError: An extractor error has occurred. (caused by KeyError('streams',)); please report this issue on https://yt-dl.org/bug . Make sure you 
are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
```


```
youtube-dl.exe --version
2017.10.29
```
@imseandavis
Copy link

@imseandavis imseandavis commented Dec 13, 2017

I wrote literally almost the exact same thing to keepvid support about vrv.co premium content. But I added the process to decode premium content as well. They use Ellation Player and now after defeating their last way of encoding they have moved on to base64 encrypting the video string in the url.

@imseandavis
Copy link

@imseandavis imseandavis commented Dec 13, 2017

I can show you how to decode premium links but it's a multistep process with the way they hide their URLs now, but once you get the raw URL you can download any content they have. Message me and I'll show you how.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
4 participants
You can’t perform that action at this time.