Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Possible problem with proxy interaction #19004

Closed
Typhonragewind opened this issue Jan 25, 2019 · 2 comments
Closed

Possible problem with proxy interaction #19004

Typhonragewind opened this issue Jan 25, 2019 · 2 comments

Comments

@Typhonragewind
Copy link

@Typhonragewind Typhonragewind commented Jan 25, 2019

Please follow the guide below

  • You will be asked some questions and requested to provide some information, please read them carefully and answer honestly
  • Put an x into all the boxes [ ] relevant to your issue (like this: [x])
  • Use the Preview tab to see what your issue will actually look like

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2019.01.24. If it's not, read this FAQ entry and update. Issues with outdated version will be rejected.

  • I've verified and I assure that I'm running youtube-dl 2019.01.24

Before submitting an issue make sure you have:

  • At least skimmed through the README, most notably the FAQ and BUGS sections
  • Searched the bugtracker for similar issues including closed ones
  • Checked that provided video/audio/playlist URLs (if any) are alive and playable in a browser

What is the purpose of your issue?

  • Bug report (encountered problems with youtube-dl)
  • Site support request (request for adding support for a new site)
  • Feature request (request for a new functionality)
  • Question
  • Other

The following sections concretize particular purposed issues, you can erase any section (the contents between triple ---) not applicable to your issue


If the purpose of this issue is a bug report, site support request or you are not completely sure provide the full verbose output as follows:

Add the -v flag to your command line you run youtube-dl with (youtube-dl -v <your command line>), copy the whole output and insert it here. It should look similar to one below (replace it with your log inserted between triple ```):


youtube-dl.exe -v -o "%animeOutputDir%%%(playlist)s\%%(season)s\%%(episode_number)03d-%%(title)s.%%(ext)s" --download-archive downloadLists/"%listname%".txt --geo-verification-proxy http://proxyauthentication@pmyproxy.me:8080 --sub-lang enUS --write-sub --recode-video mkv --postprocessor-args "-vf yadif=0:-1:0,hqdn3d" --ffmpeg-location %ffmpegloc% %animeLink%

Link= https://www.crunchyroll.com/steinsgate-0
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-v', '-o', 'D:\\Downloads\\Anime\\%(playlist)s\\%(season)s\\%(episode_number)03d-%(title)s.%(ext)s', '--download-archive', 'downloadLists/steinsgate-0.txt', '--geo-verification-proxy', 'http://proxyauthentication@myproxy.com:8080', '--sub-lang', 'enUS', '--write-sub', '--recode-video', 'mkv', '--postprocessor-args', '-vf yadif=0:-1:0,hqdn3d', '--ffmpeg-location', 'D:\\OneDrive\\Programas\\Youtube-dl\\ffmpeg\\ffmpeg.exe', 'https://www.crunchyroll.com/steinsgate-0']
[debug] Encodings: locale cp1252, fs mbcs, out cp437, pref cp1252
[debug] youtube-dl version 2019.01.24
[debug] Python version 3.4.4 (CPython) - Windows-10-10.0.17763
[debug] exe versions: ffmpeg N-92906-g54109b1d14, ffprobe N-92906-g54109b1d14
[debug] Proxy map: {}
[crunchyroll:playlist] steinsgate-0: Downloading webpage
[download] Downloading playlist: Steins;Gate 0
[crunchyroll:playlist] playlist Steins;Gate 0: Collected 24 video ids (downloading 24 of them)
[download] Downloading video 1 of 24
[crunchyroll] 769499: Downloading webpage
[crunchyroll] 769499: Downloading audio-jaJP m3u8 information
[crunchyroll] 769499: Downloading audio-jaJP-hardsub-enUS m3u8 information
[crunchyroll] 769499: Downloading media info
[debug] Default format spec: bestvideo+bestaudio/best
[info] Writing video subtitles to: D:\Downloads\Anime\Steins;Gate 0\Steins;Gate 0\001-Steins;Gate 0 Episódio 1 – Missing Link of the Annihilator -Absolute Zero-.enUS.ass
[debug] Invoking downloader on 'https://v.vrv.co/evs/24fc2abf69faa84ced17c87d0f1fddf3/assets/8742fd79eb503fdb3b16c2622b6e6e9e_3445083.mp4/index-v1-a1.m3u8?Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly92LnZydi5jby9ldnMvMjRmYzJhYmY2OWZhYTg0Y2VkMTdjODdkMGYxZmRkZjMvYXNzZXRzLyoiLCJDb25kaXRpb24iOnsiRGF0ZUxlc3NUaGFuIjp7IkFXUzpFcG9jaFRpbWUiOjE1NDg2Mjc2MDB9fX1dfQ__&Signature=o~wNy-p0j4EjAlBSdjnwNUcWPh-wpn-tpA1TC5kbtUGPHlAE626TOoTz4ITMoCRjhuNu3ajA9Wgq-g2EzDdH~B18VYGfmbka-sa-2PbknSk5XFtPxvk~Tfx5DR553s8xgDgwV68MVohKnPPFVg654NEczXnZi1vGu9PTxCG8xi5fnF1vYR~dVVhLBAqFe~41r84t5ZjcaoVI3xfGfz-ZH-4zJ2uP-H4sk0nhaADmAf-jF7eDHIEmBc-U~1N8WKyWKAsGNC60~icYJVoLjb7br4UT6RyXEv6nMAiNYRW36bGm11sKTn7-Pp-T75qq0i5PcCYIBgVcKBNvw~JabdpEdg__&Key-Pair-Id=APKAJKQQ2INNHTYFB44A'
[download] Destination: D:\Downloads\Anime\Steins;Gate 0\Steins;Gate 0\001-Steins;Gate 0 Episódio 1 – Missing Link of the Annihilator -Absolute Zero-.mp4
[debug] ffmpeg command line: "D:\OneDrive\Programas\Youtube-dl\ffmpeg\ffmpeg" -y -loglevel verbose -headers "Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
Accept-Encoding: gzip, deflate
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:59.0) Gecko/20100101 Firefox/59.0
Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
Accept-Language: en-us,en;q=0.5
" -i "https://v.vrv.co/evs/24fc2abf69faa84ced17c87d0f1fddf3/assets/8742fd79eb503fdb3b16c2622b6e6e9e_3445083.mp4/index-v1-a1.m3u8?Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly92LnZydi5jby9ldnMvMjRmYzJhYmY2OWZhYTg0Y2VkMTdjODdkMGYxZmRkZjMvYXNzZXRzLyoiLCJDb25kaXRpb24iOnsiRGF0ZUxlc3NUaGFuIjp7IkFXUzpFcG9jaFRpbWUiOjE1NDg2Mjc2MDB9fX1dfQ__&Signature=o~wNy-p0j4EjAlBSdjnwNUcWPh-wpn-tpA1TC5kbtUGPHlAE626TOoTz4ITMoCRjhuNu3ajA9Wgq-g2EzDdH~B18VYGfmbka-sa-2PbknSk5XFtPxvk~Tfx5DR553s8xgDgwV68MVohKnPPFVg654NEczXnZi1vGu9PTxCG8xi5fnF1vYR~dVVhLBAqFe~41r84t5ZjcaoVI3xfGfz-ZH-4zJ2uP-H4sk0nhaADmAf-jF7eDHIEmBc-U~1N8WKyWKAsGNC60~icYJVoLjb7br4UT6RyXEv6nMAiNYRW36bGm11sKTn7-Pp-T75qq0i5PcCYIBgVcKBNvw~JabdpEdg__&Key-Pair-Id=APKAJKQQ2INNHTYFB44A" -c copy -f mp4 "-bsf:a" aac_adtstoasc "file:D:\Downloads\Anime\Steins;Gate 0\Steins;Gate 0\001-Steins;Gate 0 Episódio 1 – Missing Link of the Annihilator -Absolute Zero-.mp4.part"
ffmpeg version N-92906-g54109b1d14 Copyright (c) 2000-2019 the FFmpeg developers
  built with gcc 8.2.1 (GCC) 20181201
  configuration: --enable-gpl --enable-version3 --enable-sdl2 --enable-fontconfig --enable-gnutls --enable-iconv --enable-libass --enable-libbluray --enable-libfreetype --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-libopus --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libtheora --enable-libtwolame --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxml2 --enable-libzimg --enable-lzma --enable-zlib --enable-gmp --enable-libvidstab --enable-libvorbis --enable-libvo-amrwbenc --enable-libmysofa --enable-libspeex --enable-libxvid --enable-libaom --enable-libmfx --enable-amf --enable-ffnvcodec --enable-cuvid --enable-d3d11va --enable-nvenc --enable-nvdec --enable-dxva2 --enable-avisynth --enable-libopenmpt
  libavutil      56. 25.100 / 56. 25.100
  libavcodec     58. 43.100 / 58. 43.100
  libavformat    58. 25.100 / 58. 25.100
  libavdevice    58.  6.101 / 58.  6.101
  libavfilter     7. 46.101 /  7. 46.101
  libswscale      5.  4.100 /  5.  4.100
  libswresample   3.  4.100 /  3.  4.100
  libpostproc    55.  4.100 / 55.  4.100
[tcp @ 00000245bb1bef80] Starting connection attempt to 13.32.90.83 port 443
[tcp @ 00000245bb1bef80] Successfully connected to 13.32.90.83 port 443
[hls,applehttp @ 00000245bb1bb400] HLS request for url 'https://v.vrv.co/evs/24fc2abf69faa84ced17c87d0f1fddf3/assets/8742fd79eb503fdb3b16c2622b6e6e9e_3445083.mp4/seg-1-v1-a1.ts?Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly92LnZydi5jby9ldnMvMjRmYzJhYmY2OWZhYTg0Y2VkMTdjODdkMGYxZmRkZjMvYXNzZXRzLzg3NDJmZDc5ZWI1MDNmZGIzYjE2YzI2MjJiNmU2ZTllXzM0NDUwODMubXA0LyoiLCJDb25kaXRpb24iOnsiRGF0ZUxlc3NUaGFuIjp7IkFXUzpFcG9jaFRpbWUiOjE1NDg1NDEyMDN9fX1dfQ__&Signature=N~0qX0KHC9J6eTPNKOMJX0SecS5rnGz6aPfoAiUR8ClD00BDrv1vIeI5i2TOJybqGB1pVUVi7WipF3zCnFmAA2E6Y9T541VWIOFc4EX6GYh~JeEbCn5OQxRoEwLEaQpbaAhuxzWm7-TCbJPo9gkJh6FvVw2ZOwwOA~XZJV8v5y9yjon0R1-tcgNVGqz5q-4OVEqbzGHrHNxqvI63BM2xznZOull5gG25uf0DFfn18u0VkQ34wGzxEYM-aqribz4bkrfxC384heW~7NFWxoFz1m6YNlAjhwk9eSvYD7Us7P1kxVb-9ykkyb2iKaLNjZ4vSSj-ebhovE5TRFSGyIU5Xw__&Key-Pair-Id=APKAJMWSQ5S7ZB3MF5VA', offset 0, playlist 0
[hls,applehttp @ 00000245bb1bb400] Opening 'https://v.vrv.co/evs/24fc2abf69faa84ced17c87d0f1fddf3/assets/8742fd79eb503fdb3b16c2622b6e6e9e_3445083.mp4/encryption.key?Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly92LnZydi5jby9ldnMvMjRmYzJhYmY2OWZhYTg0Y2VkMTdjODdkMGYxZmRkZjMvYXNzZXRzLzg3NDJmZDc5ZWI1MDNmZGIzYjE2YzI2MjJiNmU2ZTllXzM0NDUwODMubXA0LyoiLCJDb25kaXRpb24iOnsiRGF0ZUxlc3NUaGFuIjp7IkFXUzpFcG9jaFRpbWUiOjE1NDg1NDEyMDN9fX1dfQ__&Signature=N~0qX0KHC9J6eTPNKOMJX0SecS5rnGz6aPfoAiUR8ClD00BDrv1vIeI5i2TOJybqGB1pVUVi7WipF3zCnFmAA2E6Y9T541VWIOFc4EX6GYh~JeEbCn5OQxRoEwLEaQpbaAhuxzWm7-TCbJPo9gkJh6FvVw2ZOwwOA~XZJV8v5y9yjon0R1-tcgNVGqz5q-4OVEqbzGHrHNxqvI63BM2xznZOull5gG25uf0DFfn18u0VkQ34wGzxEYM-aqribz4bkrfxC384heW~7NFWxoFz1m6YNlAjhwk9eSvYD7Us7P1kxVb-9ykkyb2iKaLNjZ4vSSj-ebhovE5TRFSGyIU5Xw__&Key-Pair-Id=APKAJMWSQ5S7ZB3MF5VA' for reading
[tcp @ 00000245bb74f3c0] Starting connection attempt to 13.32.90.83 port 443

<end of log>

Description of your issue, suggested solution and other information

So, I've been using youtube-dl for a while now without a single problem to download videos from crunchyroll (whole playlists and then keep them updated via a script). To do this i make use of a japanese proxy for authentication (proxy details obfuscated in previous log) and my regular connection for the download.
The output titles (from %(title)s) usually come in english, such as "Episode 1 - Blah bla blah", as they are shown in the site. But a few days ago they suddenly started to come in portuguese (i'm located in portugal), even with the japanese proxy. I haven't changed the command since early December of the previous year, so i doubt it's a syntax error.

My observations are:

  • Youtube-dl still downloads region restricted content, so the proxy is working;
  • If i run the command normally all the titles come in portuguese, as if i had accessed crunchyroll without a proxy;
  • If i access crunchyroll with this same proxy via browser i still get the titles in english;
  • If i run my regular command while under a US VPN the titles come in english;
  • I have tried all of the above on a different network (work), with the same results.

I have contacted my proxy provider and i was told that no modification was done to the proxy servers or their configurations, but i have no way to ascertain the truth about this.

What could be the origin of the problem:

  • Proxy has messed configurations (i don't have another form a different provider so i can't test it);
  • Crunchyroll has subtly changed how they handle requests and thus the youtube-dl extractor is being funny;
  • Some arcane network thing i'm not even aware of;
  • Something is leaking?...

I'm a newbie on all things network related, so take my opinions with a ton of grains of salt.

@dstftw
Copy link
Collaborator

@dstftw dstftw commented Jan 26, 2019

For any work on that you must provide reproducible environment.

@dstftw dstftw closed this Jan 26, 2019
@Typhonragewind
Copy link
Author

@Typhonragewind Typhonragewind commented Jan 26, 2019

And how exactly am I supposed to provide one?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
2 participants
You can’t perform that action at this time.