Browse files

Added robots.txt to static.

  • Loading branch information...
1 parent 31b73a8 commit 2473f0789cd335387011eeb11d14ab26e18b486e @jgm committed Aug 22, 2009
Showing with 5 additions and 0 deletions.
  1. +2 −0 README.markdown
  2. +2 −0 data/static/robots.txt
  3. +1 −0 gitit.cabal
@@ -216,6 +216,8 @@ So, you can throw anything you want to be served statically (for
example, a `robots.txt` file or `favicon.ico`) in the `static`
directory. You can override any of gitit's default css, javascript, or
image files by putting a file with the same relative path in `static`.
+Note that gitit has a default `robots.txt` file that excludes all
+URLs beginning with `/_`.
Note: if you set `static-dir` to be a subdirectory of `repository-path`,
and then add the files in the static directory to your repository, you
@@ -0,0 +1,2 @@
+User-agent: *
+Disallow: /_
@@ -52,6 +52,7 @@ data-files: data/static/css/screen.css, data/static/css/print.css,
data/static/js/preview.js, data/static/js/search.js,
+ data/static/robots.txt,
data/post-update, data/, data/,
data/markup.Markdown, data/markup.RST,
data/markup.HTML, data/markup.LaTeX,

0 comments on commit 2473f07

Please sign in to comment.