New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Change robot.txt on creativecommons.net or scrap the site #762

Open
mzeinstra opened this Issue Mar 8, 2018 · 1 comment

Comments

Projects
None yet
3 participants
@mzeinstra

mzeinstra commented Mar 8, 2018

Creativecommons.net now redirects to creativecommons.org. however its content is still being indexed by search engines and available if you have a direct link like: https://creativecommons.net/r/paul/works/

I suggest removing the site and redirect all traffic to .org or change the robot.txt to stop it indexing the site.

@xolotl

This comment has been minimized.

xolotl commented Apr 16, 2018

Ensure redirects handle edge cases like https://creativecommons.net/join%20

@robmyers robmyers removed their assignment Sep 7, 2018

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment