Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bilibili - Unable to download majority of videos #25891

Closed
bjsm19 opened this issue Jul 4, 2020 · 4 comments
Closed

Bilibili - Unable to download majority of videos #25891

bjsm19 opened this issue Jul 4, 2020 · 4 comments

Comments

@bjsm19
Copy link

@bjsm19 bjsm19 commented Jul 4, 2020

Checklist

  • I'm reporting a broken site support
  • I've verified that I'm running youtube-dl version 2020.06.16.1
  • I've checked that all provided URLs are alive and playable in a browser
  • I've checked that all URLs and arguments with special characters are properly quoted or escaped
  • I've searched the bugtracker for similar issues including closed ones

Verbose log

C:\Users\User>youtube-dl -v https://www.bilibili.com/video/BV1xW411K7Ko
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-v', 'https://www.bilibili.com/video/BV1xW411K7Ko']
[debug] Encodings: locale cp1252, fs utf-8, out utf-8, pref cp1252
[debug] youtube-dl version 2020.06.16.1
[debug] Python version 3.8.3 (CPython) - Windows-10-10.0.19041-SP0
[debug] exe versions: ffmpeg git-2020-05-27-8b5ffae, ffprobe git-2020-05-27-8b5ffae
[debug] Proxy map: {}
[BiliBili] 1xW411K7Ko: Downloading webpage
[BiliBili] 1xW411K7Ko: Downloading video info page
[debug] Default format spec: bestvideo+bestaudio/best
[debug] Invoking downloader on 'http://upos-hz-mirrorakam.akamaized.net/upgcxcode/89/57/36075789/36075789_da2-1-32.flv?e=ig8euxZM2rNcNbNahbUVhoMg7zNBhwdEto8g5X10ugNcXBlqNxHxNEVE5XREto8KqJZHUa6m5J0SqE85tZvEuENvNC8xNEVE9EKE9IMvXBvE2ENvNCImNEVEK9GVqJIwqa80WXIekXRE9IMvXBvEuENvNCImNEVEua6m2jIxux0CkF6s2JZv5x0DQJZY2F8SkXKE9IB5QK==&deadline=1593878617&gen=playurl&nbs=1&oi=1892137221&os=akam&platform=pc&trid=588c7a80fc3248b6aa75be38ccbd525a&uipk=5&upsig=085622ba8435faef75c6507359f1d430&uparams=e,deadline,gen,nbs,oi,os,platform,trid,uipk&hdnts=exp=1593878617~hmac=b59e74feb3d05b1e774e0e6d532d61820a0d09ff8ced2ec9b9cb749bcfb73317&mid=0'
[download] Destination: 3rd関東立海全景映像-1xW411K7Ko.flv
[download]   5.4% of 1.08GiB at 676.31KiB/s ETA 26:19[download] Got server HTTP error: Downloaded 62914560 bytes, expected 1156656368 bytes. Retrying (attempt 1 of 10)...
[download] Destination: 3rd関東立海全景映像-1xW411K7Ko.flv
[download]   5.8% of 1.08GiB at  1.43MiB/s ETA 12:07         [download] Got server HTTP error: Downloaded 67108864 bytes, expected 1156656368 bytes. Retrying (attempt 2 of 10)...
[download] Destination: 3rd関東立海全景映像-1xW411K7Ko.flv
[download]   7.6% of 1.08GiB at 589.64KiB/s ETA 29:29        [download] Got server HTTP error: Downloaded 88080384 bytes, expected 1156656368 bytes. Retrying (attempt 3 of 10)...
[download] Destination: 3rd関東立海全景映像-1xW411K7Ko.flv
[download]   9.1% of 1.08GiB at 475.24KiB/s ETA 36:01        [download] Got server HTTP error: Downloaded 104857600 bytes, expected 1156656368 bytes. Retrying (attempt 4 of 10)...
[download] Destination: 3rd関東立海全景映像-1xW411K7Ko.flv
[download]  12.7% of 1.08GiB at 654.36KiB/s ETA 25:07        [download] Got server HTTP error: Downloaded 146800640 bytes, expected 1156656368 bytes. Retrying (attempt 5 of 10)...
[download] Destination: 3rd関東立海全景映像-1xW411K7Ko.flv
[download]  13.1% of 1.08GiB at  1.88MiB/s ETA 08:29         [download] Got server HTTP error: Downloaded 150994944 bytes, expected 1156656368 bytes. Retrying (attempt 6 of 10)...
[download] Destination: 3rd関東立海全景映像-1xW411K7Ko.flv
[download]  13.4% of 1.08GiB at  1.02MiB/s ETA 15:36         [download] Got server HTTP error: Downloaded 155189248 bytes, expected 1156656368 bytes. Retrying (attempt 7 of 10)...
[download] Destination: 3rd関東立海全景映像-1xW411K7Ko.flv
[download]  13.8% of 1.08GiB at  1.72MiB/s ETA 09:14         [download] Got server HTTP error: Downloaded 159383552 bytes, expected 1156656368 bytes. Retrying (attempt 8 of 10)...
[download] Destination: 3rd関東立海全景映像-1xW411K7Ko.flv
[download]  15.6% of 1.08GiB at 717.73KiB/s ETA 22:08        [download] Got server HTTP error: Downloaded 180355072 bytes, expected 1156656368 bytes. Retrying (attempt 9 of 10)...
ERROR: unable to download video data: Remote end closed connection without response
Traceback (most recent call last):
  File "c:\python\lib\site-packages\youtube_dl\YoutubeDL.py", line 1926, in process_info
    success = dl(filename, info_dict)
  File "c:\python\lib\site-packages\youtube_dl\YoutubeDL.py", line 1865, in dl
    return fd.download(name, info)
  File "c:\python\lib\site-packages\youtube_dl\downloader\common.py", line 366, in download
    return self.real_download(filename, info_dict)
  File "c:\python\lib\site-packages\youtube_dl\downloader\http.py", line 341, in real_download
    establish_connection()
  File "c:\python\lib\site-packages\youtube_dl\downloader\http.py", line 109, in establish_connection
    ctx.data = self.ydl.urlopen(request)
  File "c:\python\lib\site-packages\youtube_dl\YoutubeDL.py", line 2238, in urlopen
    return self._opener.open(req, timeout=self._socket_timeout)
  File "c:\python\lib\urllib\request.py", line 525, in open
    response = self._open(req, data)
  File "c:\python\lib\urllib\request.py", line 542, in _open
    result = self._call_chain(self.handle_open, protocol, protocol +
  File "c:\python\lib\urllib\request.py", line 502, in _call_chain
    result = func(*args)
  File "c:\python\lib\site-packages\youtube_dl\utils.py", line 2578, in http_open
    return self.do_open(functools.partial(
  File "c:\python\lib\urllib\request.py", line 1354, in do_open
    r = h.getresponse()
  File "c:\python\lib\http\client.py", line 1332, in getresponse
    response.begin()
  File "c:\python\lib\http\client.py", line 303, in begin
    version, status, reason = self._read_status()
  File "c:\python\lib\http\client.py", line 272, in _read_status
    raise RemoteDisconnected("Remote end closed connection without"
http.client.RemoteDisconnected: Remote end closed connection without response

Description

Have not been able to download majority of bilibili videos since last week. For smaller-sized videos, I have been able to complete downloading after trying again a couple of times, but this approach doesn't work for the larger-sized files [>60 mins] (but there have been a small number of exceptions e.g. https://www.bilibili.com/video/BV14W411T7T1).

I have tried downloading using a different computer, as well as a different wi-fi account, but the error still happens.

@Nosgoroth
Copy link

@Nosgoroth Nosgoroth commented Jul 25, 2020

Same issue here.

@bjsm19
Copy link
Author

@bjsm19 bjsm19 commented Aug 9, 2020

This article solves my problem: [https://bobcares.com/blog/windows-error-10054/]

@bjsm19 bjsm19 closed this Aug 9, 2020
@Nosgoroth
Copy link

@Nosgoroth Nosgoroth commented Aug 9, 2020

That isn't helpful, as this issue is also occurring on a Mac. Could you provide more details?

@bjsm19
Copy link
Author

@bjsm19 bjsm19 commented Aug 9, 2020

I'm not too sure if we are facing the same issue but this is what happened for me: Subsequent to the post, I had other error messages such as winerror 10054 in conjunction with errno 11001 getaddrinfo failed. But the downloads usually could resume if I keep trying (after every couple of hours) but it still didn't work for the bigger videos. The whole thing was getting so time-consuming that I stopped.

Yesterday I attempted again, and this time I could not download at all because the connection was immediately forcibly closed. Since the problem now had a clear cause, I got rid of the problem by reviewing my existing firewall configuration as per the article's advice. After that, I tried downloading around three or four big files (>1 gb) as a test across two days, and it went smoothly so I decided to close the issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
2 participants
You can’t perform that action at this time.