[Feature]: Support ShadowDOM for Page.content()

[mantou132]

🚀 Feature Request

current Page.content() not include shadow dom content

Example

API:

await page.content({ serializableShadowRoots: true });

Related spec: https://html.spec.whatwg.org/#dom-parsing-and-serialization

Implement

const doctype = document.doctype
  ? new XMLSerializer().serializeToString(document.doctype)
  : '';
// https://html.spec.whatwg.org/#dom-parsing-and-serialization
if (!('getHTML' in Element.prototype)) {
  return `${doctype}${document.documentElement.outerHTML}`;
}
const body = (document.documentElement as any).getHTML({ serializableShadowRoots: true });
const uid = crypto.randomUUID();
document.documentElement.innerHTML = uid;
return `${doctype}${document.documentElement.outerHTML.replace(
  uid,
  body
)}`;

Motivation

Let the crawler(e.g: renderscript) grab everything