Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

youtube-dl extracts some invalid ids from user video pages on pornhub.com #21046

Closed
throwaway75 opened this issue May 10, 2019 · 1 comment
Closed
Labels

Comments

@throwaway75
Copy link

@throwaway75 throwaway75 commented May 10, 2019

Checklist

  • I'm reporting a broken site support
  • I've verified that I'm running youtube-dl version 2019.04.30
  • I've checked that all provided URLs are alive and playable in a browser
  • I've checked that all URLs and arguments with special characters are properly quoted or escaped
  • I've searched the bugtracker for similar issues including closed ones

Verbose log

youtube-dl --verbose  --add-metadata --embed-thumbnail   https://www.pornhub.com/model/rosieandalena/videos/
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'--verbose', u'--add-metadata', u'--embed-thumbnail', u'https://www.pornhub.com/model/rosieandalena/videos/']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2019.04.30
[debug] Python version 2.7.16 (CPython) - Linux-4.18.0-17-generic-x86_64-with-Ubuntu-18.10-cosmic
[debug] exe versions: ffmpeg 4.0.2-2, ffprobe 4.0.2-2, phantomjs 2.1.1, rtmpdump 2.4
[debug] Proxy map: {}
[PornHubUserVideos] rosieandalena: Downloading page 1
[PornHubUserVideos] rosieandalena: Downloading page 2
[PornHubUserVideos] rosieandalena: Downloading page 3
[PornHubUserVideos] rosieandalena: Downloading page 4
[download] Downloading playlist: rosieandalena
[PornHubUserVideos] playlist rosieandalena: Collected 132 video ids (downloading 132 of them)
[download] Downloading video 1 of 132
[PornHub] ph5cbfc9aaae5fa: Downloading pc webpage
[PornHub] ph5cbfc9aaae5fa: Downloading tv webpage
ERROR: Unable to download webpage: HTTP Error 404: Not Found (caused by HTTPError()); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 626, in _request_webpage
    return self._downloader.urlopen(url_or_request)
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 2227, in urlopen
    return self._opener.open(req, timeout=self._socket_timeout)
  File "/usr/lib/python2.7/urllib2.py", line 435, in open
    response = meth(req, response)
  File "/usr/lib/python2.7/urllib2.py", line 548, in http_response
    'http', request, response, code, msg, hdrs)
  File "/usr/lib/python2.7/urllib2.py", line 467, in error
    result = self._call_chain(*args)
  File "/usr/lib/python2.7/urllib2.py", line 407, in _call_chain
    result = func(*args)
  File "/usr/lib/python2.7/urllib2.py", line 654, in http_error_302
    return self.parent.open(new, timeout=req.timeout)
  File "/usr/lib/python2.7/urllib2.py", line 435, in open
    response = meth(req, response)
  File "/usr/lib/python2.7/urllib2.py", line 548, in http_response
    'http', request, response, code, msg, hdrs)
  File "/usr/lib/python2.7/urllib2.py", line 473, in error
    return self._call_chain(*args)
  File "/usr/lib/python2.7/urllib2.py", line 407, in _call_chain
    result = func(*args)
  File "/usr/lib/python2.7/urllib2.py", line 556, in http_error_default
    raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)

Description

youtube-dl extracts some invalid ids from user video pages on pornhub.com. Example url: https://www.pornhub.com/model/rosieandalena/videos/
This problem can be worked around with the "-c" option.
I think the problem is caused by fan videos.

@dstftw
Copy link
Collaborator

@dstftw dstftw commented May 10, 2019

These are perfectly valid ids not available for regular users. This is expected behavior. -c has nothing to do with working around.

@dstftw dstftw closed this May 10, 2019
@dstftw dstftw added the invalid label May 10, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
2 participants
You can’t perform that action at this time.