Puppeteer Worker only allows .html or no declared extension

[madolinn]

unlighthouse/packages/core/src/puppeteer/worker.ts

Line 111 in a792d16

if (!extension.includes('html')) {

Unlighthouse will not crawl, nor accept routes through a sitemap, that are explicitly defined filetypes that could potentially return HTML content that aren't HTML file formats.

ASPX, PHP, etc are some valid response extensions that would return potentially valid and parse able HTML documents.

Adding a whitelist extensions option for routes could resolve this.