Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Transfert-stall #3741

Closed
MilkTeaD opened this issue Sep 13, 2014 · 6 comments
Closed

Transfert-stall #3741

MilkTeaD opened this issue Sep 13, 2014 · 6 comments

Comments

@MilkTeaD
Copy link

@MilkTeaD MilkTeaD commented Sep 13, 2014

Hello,
It seems that there is no timeout. Using Youtube-dl on ARMhf (Odroid U3) Xubuntu. On my broadband-link, the trnasfert stalls.
It speeds up from 2 -> 3 MiB/s and then I have to interrupt it. I suppose you use wget. All my wget I us with the options -T 5 -t 0 (continuous retry, with a general timeout of 5 secs). Setting my eth0 speed down to 1 MiB or changing mtu to 500 did not help.
I have to interrupt with -c and luckily it resumes.
M.

@jaimeMF
Copy link
Collaborator

@jaimeMF jaimeMF commented Sep 14, 2014

Could you post the output of youtube-dl --verbose THE_URL?

@MilkTeaD
Copy link
Author

@MilkTeaD MilkTeaD commented Sep 16, 2014

okido
it stalls at 20.8 % after 2 minutes I pressed +c and same command,
then I let it do. And it went in a timeout after about 6-7 minutes. (i saw
it after 10 minutes, so I suppose it was earlier).
It is the same experience I had with wget. So, i you want I can tell you
exactly the observations I made.

M.

$ ../youtube-dl --verbose https://www.youtube.com/watch?v=g5fi7lmlQmM
[debug] System config: []
[debug] User config: []
[debug] Command-line args: ['--verbose', '
https://www.youtube.com/watch?v=g5fi7lmlQmM']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2014.09.12
[debug] Python version 2.7.6 -
Linux-3.8.13.14-armv7l-with-Ubuntu-14.04-trusty
[debug] Proxy map: {}
[youtube] Setting language
[youtube] Confirming age
[youtube] g5fi7lmlQmM: Downloading webpage
[youtube] g5fi7lmlQmM: Downloading video info webpage
[youtube] g5fi7lmlQmM: Extracting video information
[debug] Invoking downloader on u'
https://r4---sn-bvvbax-cg0e.googlevideo.com/videoplayback?initcwndbps=2147000&ratebypass=yes&mm=31&mt=1410897649&mv=m&ms=au&signature=2840C6A2170D434764F3321B5E4EC12303B74781.2F46B5AB208C343182B346ED39E1415D99F50746&sver=3&requiressl=yes&key=yt5&ip=141.134.159.143&ipbits=0&source=youtube&sparams=id%2Cinitcwndbps%2Cip%2Cipbits%2Citag%2Cmm%2Cms%2Cmv%2Cratebypass%2Crequiressl%2Csource%2Cupn%2Cexpire&fexp=908547%2C924639%2C927622%2C930666%2C931345%2C931983%2C932404%2C934030%2C945539%2C946021%2C947209%2C953801&id=o-AEw36R4VQTZzBpvswRNS1j3fqiqzubxXK1TlA15m9MAY&upn=0O6ZOjQEoKM&itag=22&expire=1410919311
'
[download] Destination: Jim Jefferies - Bare (Full show)-g5fi7lmlQmM.mp4
[download] 20.8% of 780.90MiB at 2.90MiB/s ETA 03:33^C
ERROR: Interrupted by user
$ ../youtube-dl --verbose https://www.youtube.com/watch?v=g5fi7lmlQmM
[debug] System config: []
[debug] User config: []
[debug] Command-line args: ['--verbose', '
https://www.youtube.com/watch?v=g5fi7lmlQmM']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2014.09.12
[debug] Python version 2.7.6 -
Linux-3.8.13.14-armv7l-with-Ubuntu-14.04-trusty
[debug] Proxy map: {}
[youtube] Setting language
[youtube] Confirming age
[youtube] g5fi7lmlQmM: Downloading webpage
[youtube] g5fi7lmlQmM: Downloading video info webpage
[youtube] g5fi7lmlQmM: Extracting video information
[debug] Invoking downloader on u'
https://r4---sn-bvvbax-cg0e.googlevideo.com/videoplayback?requiressl=yes&expire=1410919522&source=youtube&initcwndbps=2128000&ipbits=0&key=yt5&id=o-AJ-JJBghcJzb7kRUDXsrKq4vBuZHpbGw6zQsJnzOu_Ld&fexp=902543%2C914088%2C924638%2C927622%2C930666%2C931983%2C932404%2C934030%2C945076%2C945309%2C946023%2C947209%2C948701%2C948703%2C953801&signature=4274E9276D812611F3AC2C23C956DF29E5132C1A.C4287C122A0ABF0A37D48071CF1B10504F449569&ms=au&mt=1410897789&upn=weMsdEW-PiU&mv=m&itag=22&mm=31&ip=141.134.159.143&ratebypass=yes&sparams=id%2Cinitcwndbps%2Cip%2Cipbits%2Citag%2Cmm%2Cms%2Cmv%2Cratebypass%2Crequiressl%2Csource%2Cupn%2Cexpire&sver=3
'
[download] Resuming download at byte 170382752
[download] Destination: Jim Jefferies - Bare (Full show)-g5fi7lmlQmM.mp4
[download] 25.3% of 780.90MiB at 2.18MiB/s ETA 04:27ERROR: unable to
download video data: The read operation timed out
Traceback (most recent call last):
File "../youtube-dl/youtube_dl/YoutubeDL.py", line 1035, in process_info
success = dl(filename, info_dict)
File "../youtube-dl/youtube_dl/YoutubeDL.py", line 1011, in dl
return fd.download(name, info)
File "../youtube-dl/youtube_dl/downloader/common.py", line 291, in
download
return self.real_download(filename, info_dict)
File "../youtube-dl/youtube_dl/downloader/http.py", line 142, in
real_download
data_block = data.read(block_size if not is_test else min(block_size,
data_len - byte_counter))
File "/usr/lib/python2.7/socket.py", line 380, in read
data = self._sock.recv(left)
File "/usr/lib/python2.7/httplib.py", line 567, in read
s = self.fp.read(amt)
File "/usr/lib/python2.7/socket.py", line 380, in read
data = self._sock.recv(left)
File "/usr/lib/python2.7/ssl.py", line 341, in recv
return self.read(buflen)
File "/usr/lib/python2.7/ssl.py", line 260, in read
return self._sslobj.read(len)
SSLError: The read operation timed out

$

2014-09-14 11:59 GMT+02:00 Jaime Marquínez Ferrándiz <
notifications@github.com>:

Could you post the output
https://github.com/rg3/youtube-dl/blob/master/README.md#bugs of youtube-dl
--verbose THE_URL?


Reply to this email directly or view it on GitHub
#3741 (comment).

@sehrgut
Copy link
Contributor

@sehrgut sehrgut commented Jan 10, 2016

I'd be interested to see if there were a way we could spin off a watchdog process to detect stalled transfers heuristically and trigger retry.

@MilkTeaD
Copy link
Author

@MilkTeaD MilkTeaD commented Jan 10, 2016

that is what I do
<getit.sh>#!/bin/bashwhile truedo/home/mark/youtube-dl $1 -f bestif [ $? -eq 0 ]then        breakfidone
and run it in "screen"

  Van: sehrgut <notifications@github.com>

Aan: rg3/youtube-dl youtube-dl@noreply.github.com
Cc: MilkTeaD milktea.original@yahoo.com
Verzonden: zondag 10 januari 4:01 2016
Onderwerp: Re: [youtube-dl] Transfert-stall (#3741)

I'd be interested to see if there were a way we could spin off a watchdog process to detect stalled transfers heuristically and trigger retry.—
Reply to this email directly or view it on GitHub.

@sehrgut
Copy link
Contributor

@sehrgut sehrgut commented Jan 10, 2016

Thanks! I'll have to try that out. I may see if I can implement a
stall-killer within the pycode too, since it would be an interesting
project.

On Sun, Jan 10, 2016, 11:22 AM MilkTeaD notifications@github.com wrote:

that is what I do
<getit.sh>#!/bin/bashwhile truedo/home/mark/youtube-dl $1 -f bestif [ $?
-eq 0 ]then breakfidone
and run it in "screen"

Van: sehrgut notifications@github.com
Aan: rg3/youtube-dl youtube-dl@noreply.github.com
Cc: MilkTeaD milktea.original@yahoo.com
Verzonden: zondag 10 januari 4:01 2016
Onderwerp: Re: [youtube-dl] Transfert-stall (#3741)

I'd be interested to see if there were a way we could spin off a watchdog
process to detect stalled transfers heuristically and trigger retry.—
Reply to this email directly or view it on GitHub.


Reply to this email directly or view it on GitHub
#3741 (comment).

@dstftw
Copy link
Collaborator

@dstftw dstftw commented Aug 26, 2017

If wget has the same behavior then it's obviously network issues on your side.

@dstftw dstftw closed this Aug 26, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
4 participants
You can’t perform that action at this time.