Console spam, lagging downloader, unable to extract html5 player

[ghost]

Please follow the guide below

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2018.09.08. If it's not, read this FAQ entry and update. Issues with outdated version will be rejected.

• I've verified and I assure that I'm running youtube-dl 2018.09.08

Before submitting an issue make sure you have:

• At least skimmed through the README, most notably the FAQ and BUGS sections
• Searched the bugtracker for similar issues including closed ones
• Checked that provided video/audio/playlist URLs (if any) are alive and playable in a browser

What is the purpose of your issue?

• Bug report (encountered problems with youtube-dl)
• Site support request (request for adding support for a new site)
• Feature request (request for a new functionality)
• Question
• Other

If the purpose of this issue is a bug report, site support request or you are not completely sure provide the full verbose output as follows:

Add the -v flag to your command line you run youtube-dl with (youtube-dl -v <your command line>), copy the whole output and insert it here. It should look similar to one below (replace it with your log inserted between triple ```):

# This is mangled in around 4,000 lines of logs running concurrently with other applications. I
# have tried my best to ensure the entire chunk is here (since I am invoking the module directly in-code.
# This is printing out four times as it is running multiple jobs at the same time across threads in a pool.
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2018.09.08
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2018.09.08
[debug] youtube-dl version 2018.09.08
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2018.09.08
[debug] Git HEAD: 39f7179
[debug] Python version 3.7.0 (CPython) - Linux-4.15.0-33-generic-x86_64-with-debian-buster-sid
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2018.09.08
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2018.09.08
[debug] Git HEAD: 39f7179
[debug] Python version 3.7.0 (CPython) - Linux-4.15.0-33-generic-x86_64-with-debian-buster-sid
[debug] Git HEAD: 39f7179
[debug] Git HEAD: 39f7179
[debug] Git HEAD: 39f7179
[debug] Git HEAD: 39f7179
[debug] Python version 3.7.0 (CPython) - Linux-4.15.0-33-generic-x86_64-with-debian-buster-sid
[debug] Python version 3.7.0 (CPython) - Linux-4.15.0-33-generic-x86_64-with-debian-buster-sid
[debug] Python version 3.7.0 (CPython) - Linux-4.15.0-33-generic-x86_64-with-debian-buster-sid
[debug] Python version 3.7.0 (CPython) - Linux-4.15.0-33-generic-x86_64-with-debian-buster-sid
[debug] exe versions: ffmpeg 3.4.4-0ubuntu0.18.04.1, ffprobe 3.4.4-0ubuntu0.18.04.1
[debug] Proxy map: {}
[debug] exe versions: ffmpeg 3.4.4-0ubuntu0.18.04.1, ffprobe 3.4.4-0ubuntu0.18.04.1
[debug] Proxy map: {}
[debug] exe versions: ffmpeg 3.4.4-0ubuntu0.18.04.1, ffprobe 3.4.4-0ubuntu0.18.04.1
[debug] Proxy map: {}
[debug] exe versions: ffmpeg 3.4.4-0ubuntu0.18.04.1, ffprobe 3.4.4-0ubuntu0.18.04.1
[debug] Proxy map: {}
[debug] exe versions: ffmpeg 3.4.4-0ubuntu0.18.04.1, ffprobe 3.4.4-0ubuntu0.18.04.1
[debug] Proxy map: {}
[debug] exe versions: ffmpeg 3.4.4-0ubuntu0.18.04.1, ffprobe 3.4.4-0ubuntu0.18.04.1
[debug] Proxy map: {}

---

If the purpose of this issue is a site support request please provide all kinds of example URLs support for which should be included (replace following example URLs by yours):

• Playlist: https://www.youtube.com/watch?v=KWmShaIIF0I&list=RDKWmShaIIF0I&t=2

---

Description of your issue, suggested solution and other information

On adding a playlist mix generated by YouTube. The process takes around 5 minutes. Only around 5 or 6 videos ever get resolved.

I am invoking this module as part of a larger chunk of code, which runs multiple downloaders concurrently. Since the API changed on YouTube prompting yesterday's update, the module has been extremely slow and spammy in terms of network usage, where it was not before.

WARNING:YoutubeDL:unable to extract html5 player; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
WARNING:YoutubeDL:unable to extract html5 player; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

...will get output roughly 1,400 times before any playlist begins to be resolved. This is a massive performance hit if it is constantly polling the website.

YT_DL_OPTS = {
    # "format": "webm[abr>0]/bestaudio/best",
    "format": "ogg[abr>0]/m4a[abr>0]/webm[abr>0]/bestaudio/best",
    "ignoreerrors": "false",
    "default_search": "auto",
    "source_address": "0.0.0.0",
    "cachedir": "false",
    # currently true
    "verbose": "true" if os.getenv("REALLY_VERBOSE", False) else "false",
    # currently false
    "quiet": "true" if not os.getenv("REALLY_VERBOSE", False) else "false",
    "logger": logging.getLogger('YoutubeDL'),
}

[ghost]

Turns out the video URL part was empty due to a logic error elsewhere. This may beg the question of whether this library should be verifying this before it goes ahead and performs a load of requests on the user's behalf though.

Regardless, I will close this issue.

Thanks for the time 👍