Skip to content

Commit

Permalink
Browse files Browse the repository at this point in the history
DEVELOPER-835 enable robots.txt for prod
  • Loading branch information
pmuir committed Jul 22, 2014
1 parent 082e66b commit b5c615d
Show file tree
Hide file tree
Showing 4 changed files with 22 additions and 11 deletions.
4 changes: 0 additions & 4 deletions Rakefile
Expand Up @@ -179,10 +179,6 @@ task :deploy, [:profile, :tag_name] => [:check, :tag, :push] do |task, args|
rsync(local_path: LOCAL_CDN_PATH, host: cdn_host, remote_path: cdn_path)
end

if !$config['robots']
$resources << 'robots.txt'
end

# Deploy the site
# If we are running a non-site root build (e.g. Pull Request) we alter where the site is copied too, and we don't delete
if ENV['site_path_suffix']
Expand Down
6 changes: 4 additions & 2 deletions _config/site.yml
Expand Up @@ -26,7 +26,8 @@ profile_base: &profile
push_to_searchisko: true
minify: &minify true
metrics: true
robots: true
robots:
disallow: true
deploy:
<<: *deploy
scss:
Expand Down Expand Up @@ -69,7 +70,8 @@ profiles:
dcp_base_protocol_relative_url: //dcp.jboss.org/
dcp_base_url: http://dcp.jboss.org/
require_tag: true
robots: false
robots:
disallow: false
deploy:
<<: *deploy
path: /www_htdocs/www
Expand Down
5 changes: 0 additions & 5 deletions robots.txt

This file was deleted.

18 changes: 18 additions & 0 deletions robots.txt.slim
@@ -0,0 +1,18 @@
/ www.robotstxt.org/
/ www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449
- if site.robots.nil? || site.robots.disallow
| User-agent: *
Disallow: /

- else
| User-agent: *
Disallow: /jbossesb/docs/4.4.GA/javadoc/esb/index-all.html
Disallow: /jbossaop/docs/
Disallow: /jbossesb/docs/
Disallow: /jbossmessaging/docs/
Disallow: /jbossremoting/docs/
Disallow: /jbosstm/docs/
Disallow: /overview/mainColumnParagraphs/0..
Disallow: /schema/

0 comments on commit b5c615d

Please sign in to comment.