From 02a701350e30b5ef3a717828d0deae46994a0244 Mon Sep 17 00:00:00 2001 From: Josh Wong Date: Fri, 24 Oct 2025 08:51:46 +0900 Subject: [PATCH] Delete robots.txt We've decided to allow search engines to crawl all versions of the site again so that we can experiment with using Google Search on the docs site. --- static/robots.txt | 8 -------- 1 file changed, 8 deletions(-) delete mode 100644 static/robots.txt diff --git a/static/robots.txt b/static/robots.txt deleted file mode 100644 index 361937a6..00000000 --- a/static/robots.txt +++ /dev/null @@ -1,8 +0,0 @@ -User-agent: * -Disallow: /docs/3.*/ -Disallow: /docs/4.*/ -Allow: /docs/latest/ - -Disallow: /ja-jp/docs/3.*/ -Disallow: /ja-jp/docs/4.*/ -Allow: /ja-jp/docs/latest/