From 04aba94605fe9b32f736a4106e7964ae62c871e9 Mon Sep 17 00:00:00 2001 From: Peter Martin Date: Tue, 11 Aug 2015 10:49:42 +0200 Subject: [PATCH] Fix for "Googlebot cannot access CSS and JS files" In July 2015 a lot of people got "Googlebot cannot access CSS and JS files" notifications from Google. This PR implements the fix described here: http://upcity.com/blog/how-to-fix-googlebot-cannot-access-css-and-js-files-error-in-google-search-console/ --- robots.txt.dist | 3 +++ 1 file changed, 3 insertions(+) diff --git a/robots.txt.dist b/robots.txt.dist index e3f1c7cd31fcf..28d471567d659 100644 --- a/robots.txt.dist +++ b/robots.txt.dist @@ -27,3 +27,6 @@ Disallow: /modules/ Disallow: /plugins/ Disallow: /tmp/ +User-Agent: Googlebot +Allow: .js +Allow: .css