Skip to content

Commit

Permalink
Merge pull request #15 from gbezyuk/develop
Browse files Browse the repository at this point in the history
fix issue #10 - allow: / by default
  • Loading branch information
jezdez committed Jan 16, 2014
2 parents e17ada2 + 5eedd6f commit 1065a82
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions robots/templates/robots/rule_list.html
Expand Up @@ -4,8 +4,8 @@
{% endfor %}{% for url in rule.disallowed.all %}Disallow: {{ url.pattern }}
{% endfor %}{% if rule.crawl_delay %}Crawl-delay: {{ rule.crawl_delay }}
{% endif %}{% endfor %}{% else %}User-agent: *
Disallow: /
Allow: /
{% endif %}

{% for sitemap_url in sitemap_urls %}Sitemap: {{ sitemap_url }}
{% endfor %}
{% endfor %}

0 comments on commit 1065a82

Please sign in to comment.