robots.txt endpoint #526

Open
evanp opened this Issue Apr 1, 2013 · 2 comments

Projects

None yet

3 participants

@evanp
Collaborator
evanp commented Apr 1, 2013

It'd be good to do a robots.txt endpoint to steer robots away from places they shouldn't go.

@xray7224 xray7224 referenced this issue Apr 2, 2013
Closed

robots.txt fix #533

@mrvdb
mrvdb commented Oct 26, 2015

What happened here?, the commit 82d2647 is not in the repository. (it mentions something about a CLA not signed in #533 )

@larjona
Collaborator
larjona commented Nov 3, 2015

I think this pull request was closed by accident with lots of PR in June 2014.

Could anybody with permissions look at it?

@mrvdb I cannot find the mention to the CLA not signed, can you point us at it?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment