Block the AI bots

* https://neil-clarke.com/block-the-bots-that-feed-ai-models-by-scraping-your-website/ * https://stackoverflow.com/a/47652485/724176
hugovk · Sep 29, 2023 · 79a14a0 · 79a14a0
1 parent c13dd68
commit 79a14a0
Showing 1 changed file with 14 additions and 0 deletions.
diff --git a/robots.txt b/robots.txt
@@ -0,0 +1,14 @@
+User-agent: CCBot
+Disallow: /
+
+User-agent: ChatGPT-User
+Disallow: /
+
+User-agent: GPTBot
+Disallow: /
+
+User-agent: Google-Extended
+Disallow: /
+
+User-agent: Omgilibot
+Disallow: /