Skip to content

Create initial [robots.txt](http://www.robotstxt.org/robotstxt.html)#392

Merged
Martii merged 1 commit intoOpenUserJS:masterfrom
Martii:Issue-391robotsdottxt
Oct 23, 2014
Merged

Create initial [robots.txt](http://www.robotstxt.org/robotstxt.html)#392
Martii merged 1 commit intoOpenUserJS:masterfrom
Martii:Issue-391robotsdottxt

Conversation

@Martii
Copy link
Copy Markdown
Member

@Martii Martii commented Oct 23, 2014

Closes #391

* Remove referer check for statics
* Leaving /images and /xml in for the moment in case SEO needs this for any reason... revisit when OpenUserJS#249 is complete

Closes OpenUserJS#391
Martii added a commit that referenced this pull request Oct 23, 2014
@Martii Martii merged commit 4383702 into OpenUserJS:master Oct 23, 2014
@Martii Martii deleted the Issue-391robotsdottxt branch October 23, 2014 18:02
@Martii Martii added this to the #249 milestone Oct 27, 2014
@Martii Martii added the CODE Some other Code related issue and it should clearly describe what it is affecting in a comment. label Nov 3, 2014
@github-actions github-actions Bot locked as resolved and limited conversation to collaborators May 23, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

CODE Some other Code related issue and it should clearly describe what it is affecting in a comment.

Development

Successfully merging this pull request may close these issues.

Create a robots.txt

1 participant