Add robots.txt

The different filename is to not conflict with Mezzanine's default robots.txt. Our geany_robots.txt is delivered as /robots.txt via webserver configuration directive.
geany · Jun 9, 2019 · b149901 · b149901
1 parent cb57404
commit b149901
Showing 1 changed file with 7 additions and 0 deletions.
diff --git a/geany/static/geany_robots.txt b/geany/static/geany_robots.txt
@@ -0,0 +1,7 @@
+# robots.txt for https://www.geany.org/
+
+User-agent: *
+Crawl-delay: 20
+Allow: /
+
+Sitemap: https://www.geany.org/sitemap.xml