Skip to content

v1.4.1

Latest

Choose a tag to compare

@GeiserX GeiserX released this 04 May 08:35
acd06f9

Unify HTML URL classification and fix content sniffing

What changed

  • Extracted duplicated HTML-detection heuristics into a single _is_html_url() static method, fixing bare-host URLs (e.g. https://example.com) being misclassified as non-HTML (thanks @pacnpal for reporting in #6)
  • Content sniffing now strips leading whitespace/BOM before checking for <!DOCTYPE or <html> signatures, handling Wayback-injected scripts that appear before the real markup
  • Added case-insensitive <!doctype detection

Contributors