Disallow crawling by web-robots of search/ask URLs

[SamyPesse]

No description provided.

[linear]

RND-6701 Search URLs are crawled by Google

[changeset-bot]

🦋 Changeset detected

Latest commit: 014c570

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 1 package

Name	Type
gitbook	Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

[github-actions]

Summary of the deployments:

Version 1 (production)

Version	URL	Status
Latest commit	https://23801493.gitbook-open.pages.dev	✅
PR	https://pr3035.gitbook-open.pages.dev	✅

Version 2 (experimental)

Version	URL	Status
Vercel	https://gitbook-v2-46rb1v897-gitbook.vercel.app	✅
Cloudflare	https://eb58ff4a-gitbook-open-v2-preview.gitbook.workers.dev	✅

Test content

Site	v1	v2
GitBook	https://23801493.gitbook-open.pages.dev/docs.gitbook.com	https://gitbook-v2-46rb1v897-gitbook.vercel.app/url/docs.gitbook.com
E2E	https://23801493.gitbook-open.pages.dev/gitbook.gitbook.io/test-gitbook-open	https://gitbook-v2-46rb1v897-gitbook.vercel.app/url/gitbook.gitbook.io/test-gitbook-open

[argos-ci]

The latest updates on your projects. Learn more about Argos notifications ↗︎

Build	Status	Details	Updated (UTC)
customers-v1 (Inspect)	👍 Changes approved	1 changed	Mar 25, 2025, 1:41 PM
customers-v2 (Inspect)	⚠️ Changes detected (Review)	2 changed	Mar 25, 2025, 1:51 PM
default (Inspect)	👍 Changes approved	1 changed	Mar 25, 2025, 1:43 PM
v2-vercel (Inspect)	✅ No changes detected	-	Mar 25, 2025, 1:46 PM