Skip to content

Ci recheck#262

Closed
Kikobeats wants to merge 1 commit into
masterfrom
ci-recheck
Closed

Ci recheck#262
Kikobeats wants to merge 1 commit into
masterfrom
ci-recheck

Conversation

@Kikobeats

@Kikobeats Kikobeats commented Jul 1, 2026

Copy link
Copy Markdown
Member

The shadow DOM detector upgrades a fetch to prerender on any hyphenated
tag, which over-triggers on sites full of custom elements (e.g. YouTube's
polymer shell: ytd-app, yt-formatted-string). When a caller explicitly
passes prerender: false it has opted out of rendering, so the auto
upgrade must not override it — otherwise crawler-fetch domains get
prerendered anyway and lose their server-rendered metadata.

Co-Authored-By: Claude Opus 4.8 noreply@anthropic.com


Note

Low Risk
Small guard on an existing retry branch; reduces unintended prerendering and aligns with prior explicit-disable behavior.

Overview
Fetch-to-prerender retry after shadow-DOM detection no longer runs when the caller passes prerender: false, so fetch-only crawls keep server-rendered HTML instead of being forced through the browser.

Hyphenated custom-element tags (e.g. YouTube’s ytd-* shell) can still trigger the detector; explicit opt-out now wins over that auto-upgrade when getBrowserless is available.

Reviewed by Cursor Bugbot for commit 4a10088. Bugbot is set up for automated code reviews on this repo. Configure here.

@Kikobeats Kikobeats closed this Jul 1, 2026
@Kikobeats Kikobeats deleted the ci-recheck branch July 1, 2026 06:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant