Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add robots.txt file to UX github pages site #40

Closed
carterm opened this issue Dec 13, 2019 · 1 comment
Closed

Add robots.txt file to UX github pages site #40

carterm opened this issue Dec 13, 2019 · 1 comment
Assignees
@carterm
Milestone
Sprint 2

Comments

@carterm
Copy link
Contributor

carterm commented Dec 13, 2019

We should add a robots.txt file to the UX github site. Otherwise, this site will be crawled and steal traffic from the real site when it is released.

Recommended contents...
User-agent: *
Disallow: /

the file should appear here...
https://cagov.github.io/robots.txt

UX project...
https://github.com/cagov/UX
@carterm carterm self-assigned this Dec 13, 2019
@carterm
Copy link
Contributor Author

carterm commented Dec 17, 2019

Root site repository created with robots file.

https://github.com/cagov/cagov.github.io/

@carterm carterm closed this as completed Dec 17, 2019
@carterm carterm added this to the Sprint 2 milestone Dec 17, 2019
@abquirarte abquirarte mentioned this issue Jan 9, 2020
Closed
69 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@carterm carterm

Labels
None yet
Projects
None yet
Milestone
Sprint 2
Development

No branches or pull requests
1 participant
@carterm