Constant HTTP Error 502 messages while trying to dowload from Niconico (nicovideo.jp)

[Oscaperion]

Checklist

• I'm reporting a broken site support
• I've verified that I'm running youtube-dl version 2020.06.06
• I've checked that all provided URLs are alive and playable in a browser
• I've checked that all URLs and arguments with special characters are properly quoted or escaped
• I've searched the bugtracker for similar issues including closed ones

Verbose log

Normal error:
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-i', '-o', '%(id)s', '-w', '--write-info-json', '--download-archive', '..\\already-downloaded.txt', '--skip-download', 'https://www.nicovideo.jp/watch/sm37031328', '-v']
[debug] Encodings: locale cp1252, fs mbcs, out cp850, pref cp1252
[debug] youtube-dl version 2020.06.06
[debug] Python version 3.4.4 (CPython) - Windows-10-10.0.18362
[debug] exe versions: ffmpeg 4.2.3, ffprobe 4.2.3
[debug] Proxy map: {}
[niconico] sm37031328: Downloading webpage
ERROR: Unable to download webpage: HTTP Error 502: Bad Gateway (caused by HTTPError()); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpd0boo4lk\build\youtube_dl\extractor\common.py", line 627, in _request_webpage
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpd0boo4lk\build\youtube_dl\YoutubeDL.py", line 2238, in urlopen
  File "C:\Python\Python34\lib\urllib\request.py", line 470, in open
  File "C:\Python\Python34\lib\urllib\request.py", line 580, in http_response
  File "C:\Python\Python34\lib\urllib\request.py", line 508, in error
  File "C:\Python\Python34\lib\urllib\request.py", line 442, in _call_chain
  File "C:\Python\Python34\lib\urllib\request.py", line 588, in http_error_default

Rare error:
[niconico] sm30169300: Downloading webpage
ERROR: Unable to download webpage: IncompleteRead(14857 bytes read, 3956 more expected) (caused by IncompleteRead(14857 bytes read, 3956 more expected)); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpd0boo4lk\build\youtube_dl\extractor\common.py", line 627, in _request_webpage
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpd0boo4lk\build\youtube_dl\YoutubeDL.py", line 2238, in urlopen
  File "C:\Python\Python34\lib\urllib\request.py", line 470, in open
  File "C:\Python\Python34\lib\urllib\request.py", line 580, in http_response
  File "C:\Python\Python34\lib\urllib\request.py", line 502, in error
  File "C:\Python\Python34\lib\urllib\request.py", line 442, in _call_chain
  File "C:\Python\Python34\lib\urllib\request.py", line 685, in http_error_302
  File "C:\Python\Python34\lib\urllib\request.py", line 470, in open
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpd0boo4lk\build\youtube_dl\utils.py", line 2624, in http_response
  File "C:\Python\Python34\lib\http\client.py", line 549, in read
  File "C:\Python\Python34\lib\http\client.py", line 701, in _safe_read

Description

Niconico (nicovideo.jp) has been acting really strangely recently when trying to access its videos through youtube-dl. Sometimes it acts normally and allows downloads from the site, but most of the time it throws "HTTP Error 502" for no apparent reason. The videos themselves are normally available on the site and play as normally. When trying to access a singular video, it takes several attempts to just randomly spam the youtube-dl command line before it sometimes downloads the desired files. And even more rarely it gives an entirely different error altogether, claiming that it couldn't download all the data of the webpage. I managed to replicate the error by trying to download multiple videos, during which I was mostly bombarded by similar 502 errors.

[rivke41levp656]

ytdl-master does not properly support niconico. Try #23824.

[Oscaperion]

ytdl-master does not properly support niconico. Try #23824.

Actually, I've been downloading videos from Niconico with youtube-dl for quite some time and I've been mostly been able to use it without major problems, but I had never contacted this kind of problem before. However, in a true software malfunction fashion, after finally bringing this to other people's attention, it seems to work normally again for no reason ^__^;