HTMLParser incorrectly decodes string as HTML entities

[einstein95]

Please follow the guide below

• You will be asked some questions and requested to provide some information, please read them carefully and answer honestly
• Put an x into all the boxes [ ] relevant to your issue (like that [x])
• Use Preview tab to see how your issue will actually look like

---

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2017.01.18. If it's not read this FAQ entry and update. Issues with outdated version will be rejected.

• I've verified and I assure that I'm running youtube-dl 2017.01.18

Before submitting an issue make sure you have:

• At least skimmed through README and most notably FAQ and BUGS sections
• Searched the bugtracker for similar issues including closed ones

What is the purpose of your issue?

• Bug report (encountered problems with youtube-dl)
• Site support request (request for adding support for a new site)
• Feature request (request for a new functionality)
• Question
• Other

---

Description of your issue, suggested solution and other information

Due to the reliance of HTMLParser, any site such as PornFlip (see #11795) that contains the string &sectime in the mpd manifest URL gets incorrectly decoded to §ime. I have no knowledge of why HTMLParser does this, as § HTML-encoded is § (note the semicolon, like other HTML-encoded symbols). It is due to this that I had to rely on extracting the MP4 links rather than simply calling _parse_html5_media_entries.
I felt that I needed to inform the developers of this, in case this or a similar problem happens to any current or future developer.

[dstftw]

HTML5 allows entities without a semicolon. Thus this is perfectly legal.

[einstein95]

Albeit very stupid

[yan12125]

I guess it's PornFlip that provides broken HTML. fix_xml_ampersands can be used in such cases. If you believe there's a bug in HTMLParser, report it to http://bugs.python.org/ instead.