Skip to content

Conversation

davidalger
Copy link
Member

Per this page on Google's Webmaster Central Blog restricting Googlebot from crawling these harms their algorithms and can result in lower rankings.

- Per this (http://googlewebmastercentral.blogspot.com/2014/10/updating-our-technical-webmaster.html) page on Google's Webmaster Central Blog restricting Googlebot from crawling these harms their algorithms and can result in lower rankings.
@vpelipenko
Copy link
Contributor

CR: passed
Resolution: OK to merge

@vpelipenko
Copy link
Contributor

Thank you for contribution.

vpelipenko added a commit that referenced this pull request Jun 10, 2015
Removes .js and .css files robots.txt disallow rules
@vpelipenko vpelipenko merged commit 27a4ebc into magento:develop Jun 10, 2015
@davidalger davidalger deleted the feature/robots-txt branch July 20, 2015 20:42
magento-team pushed a commit that referenced this pull request Jul 14, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants