Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Slow URL extract on Linode #8804

Closed
jur0 opened this issue Mar 9, 2016 · 5 comments
Closed

Slow URL extract on Linode #8804

jur0 opened this issue Mar 9, 2016 · 5 comments

Comments

@jur0
Copy link

@jur0 jur0 commented Mar 9, 2016

I'm using youtube-dl on a linode server and having issues only with youtube, the other sites such as vimeo work fine. I used a profiler to check where it takes the most time:

$ python -m cProfile __main__.py -v -j https://www.youtube.com/watch?v=gLg6qxkQ94A
[debug] System config: []
[debug] User config: []
[debug] Command-line args: ['-v', '-j', 'https://www.youtube.com/watch?v=gLg6qxkQ94A']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2016.03.06
[debug] Git HEAD: 5d583bd
[debug] Python version 3.5.1 - Linux-4.4.0-x86_64-linode63-x86_64-with-arch
[debug] exe versions: none
[debug] Proxy map: {}
...
  ncalls  tottime  percall  cumtime  percall filename:lineno(function)
...
     6   24.074    4.012   24.074    4.012 {method 'connect' of '_socket.socket' objects}
...

Vimeo, for example, is much faster:

  ncalls  tottime  percall  cumtime  percall filename:lineno(function)
...
     4    0.005    0.001    0.005    0.001 {method 'connect' of '_socket.socket' objects}
...

This issue is present just on linode. Maybe youtube "blocks" linode IPs? Any ideas?

@dstftw
Copy link
Collaborator

@dstftw dstftw commented Mar 10, 2016

Try -4 option.

@jur0
Copy link
Author

@jur0 jur0 commented Mar 10, 2016

It works now. Thanks!

@jur0 jur0 closed this Mar 10, 2016
@dstftw
Copy link
Collaborator

@dstftw dstftw commented Mar 10, 2016

FYI your ipv6 is broken.

@jur0
Copy link
Author

@jur0 jur0 commented Mar 10, 2016

What do you mean exactly? The network interface has both ipv4 and ipv6 assigned.

@dstftw
Copy link
Collaborator

@dstftw dstftw commented Mar 10, 2016

Without -4 it most likely uses ipv6 that does not function properly at your side.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
2 participants
You can’t perform that action at this time.