Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Disallow crawling #170

Open
niknetniko opened this issue Jan 28, 2020 · 1 comment
Open

Disallow crawling #170

niknetniko opened this issue Jan 28, 2020 · 1 comment
Labels
level: easy Small/easy issue fixable in an evening

Comments

@niknetniko
Copy link
Member

In the footsteps of ZeusWPI/zeus.ugent.be#369, we should also provide a robots.txt file for Haldis, since it has it's own domain.

I propose to disallow crawling of the whole site, since there really isn't a reason to make this searchable I can think of (feel free to comment if you disagree).
@hannes-dev
Copy link
Member

I don't disagree

@NuttyShrimp NuttyShrimp added the level: easy Small/easy issue fixable in an evening label Oct 4, 2022
@Happilands Happilands mentioned this issue Oct 27, 2022
Merged
@AlexVDP8 AlexVDP8 removed their assignment Oct 27, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
level: easy Small/easy issue fixable in an evening
Projects
Open Issues
Status: No status
Milestone
No milestone
Development

No branches or pull requests
4 participants
@niknetniko @NuttyShrimp @hannes-dev @AlexVDP8