Skip to content

[WIP] Add robots.txt with AI bot Allow rules to docs site#47370

Closed
pelikhan with Copilot wants to merge 1 commit into
mainfrom
copilot/geo-optimizer-add-robots-txt-yet-again
Closed

[WIP] Add robots.txt with AI bot Allow rules to docs site#47370
pelikhan with Copilot wants to merge 1 commit into
mainfrom
copilot/geo-optimizer-add-robots-txt-yet-again

Conversation

Copilot AI commented Jul 22, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor
  • Inspect docs-site layout and existing robots.txt handling
  • Update the docs-site robots.txt with explicit AI bot allow rules needed by the GEO audit
  • Build or otherwise verify the docs site output includes the expected robots.txt content
  • Run final validation, secret scan, and report completed changes

Copilot AI linked an issue Jul 22, 2026 that may be closed by this pull request
[geo-optimizer] Add robots.txt with AI bot Allow rules to docs site #47369
Open
@pelikhan pelikhan closed this Jul 22, 2026
Copilot stopped work on behalf of pelikhan due to an error July 22, 2026 17:05
The session was cancelled by the user.
Copilot AI requested a review from pelikhan July 22, 2026 17:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@pelikhan pelikhan Awaiting requested review from pelikhan
Copilot code review Copilot Awaiting requested review from Copilot Copilot will automatically review once the pull request is marked ready for review

Assignees

@pelikhan pelikhan

Copilot code review Copilot

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

[geo-optimizer] Add robots.txt with AI bot Allow rules to docs site

2 participants

@pelikhan