Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with
or
.
Download ZIP
Commits on Jul 3, 2011
  1. Can now handle block_storage mapping. Correctly maps ephemeral disks …

    Philip (flip) Kromer authored
    …on EBS-backed instances.
  2. new bootstrap process, with less DNA transfer -- burning new ami

    Philip (flip) Kromer authored
Commits on Jun 6, 2011
  1. @howech

    Merge branch 'version_2' of github.com:/infochimps/cluster_chef.git

    howech authored
    Conflicts:
    	.gitignore
    	README.textile
    	cookbooks/boost/metadata.rb
    	cookbooks/build-essential/README.md
    	cookbooks/cloudera_hue/recipes/default.rb
    	cookbooks/cron/README.md
    	cookbooks/cron/metadata.rb
    	cookbooks/ganglia/README.rdoc
    	cookbooks/hadoop_cluster/recipes/format_namenode_once.rb
    	cookbooks/hadoop_cluster/recipes/hadoop_webfront.rb
    	cookbooks/hadoop_cluster/recipes/jobtracker.rb
    	cookbooks/hadoop_cluster/recipes/namenode.rb
    	cookbooks/hadoop_cluster/recipes/std_hdfs_dirs.rb
    	cookbooks/hadoop_cluster/recipes/system_internals.rb
    	cookbooks/hadoop_cluster/templates/default/apt-sources-cloudera.list.erb
    	cookbooks/hadoop_cluster/templates/default/hue.ini.erb
    	cookbooks/hbase/README.rdoc
    	cookbooks/hbase/recipes/hbase_regionserver.rb
    	cookbooks/hive/README.rdoc
    	cookbooks/rvm/recipes/.gitkeep
    	cookbooks/thrift/attributes/thrift.rb
    	cookbooks/thrift/recipes/default.rb
    	cookbooks/zookeeper/README.rdoc
    	cookbooks/zookeeper/recipes/zookeeper_server.rb
    	lib/cluster_chef/knife/bootstrap/ubuntu10.04-cluster_chef.erb
    	lib/cluster_chef/knife/cluster_bootstrap.rb
    	lib/cluster_chef/knife/cluster_launch.rb
    	lib/cluster_chef/knife/cluster_show.rb
    	notes/ec2pricing-and-capacity.numbers
    	roles/cassandra_datanode.rb
    	site-cookbooks/base/recipes/cleanup.rb
    	site-cookbooks/base/recipes/default.rb
    	site-cookbooks/benchmarkable/attributes/benchmarkable.rb
    	site-cookbooks/cassandra/attributes/cassandra.rb
    	site-cookbooks/cassandra/recipes/default.rb
    	site-cookbooks/cassandra/templates/default/iptables.erb
    	site-cookbooks/cloudera_hue/README.rdoc
    	site-cookbooks/cloudera_hue/recipes/default.rb
    	site-cookbooks/cloudera_hue/templates/default/hue.ini.erb
    	site-cookbooks/cluster_chef/README.rdoc
    	site-cookbooks/cluster_chef/recipes/cluster_webfront.rb
    	site-cookbooks/cluster_chef/recipes/dedicated_server_tuning.rb
    	site-cookbooks/ec2/README.rdoc
    	site-cookbooks/ganglia/README.rdoc
    	site-cookbooks/hadoop_cluster/attributes/hadoop_cluster.rb
    	site-cookbooks/hadoop_cluster/recipes/bootstrap_format_namenode.rb
    	site-cookbooks/hadoop_cluster/recipes/bootstrap_hdfs_dirs.rb
    	site-cookbooks/hadoop_cluster/recipes/format_namenode_once.rb
    	site-cookbooks/hadoop_cluster/recipes/hadoop_dir_perms.rb
    	site-cookbooks/hadoop_cluster/recipes/hadoop_webfront.rb
    	site-cookbooks/hadoop_cluster/recipes/namenode.rb
    	site-cookbooks/hadoop_cluster/recipes/secondarynamenode.rb
    	site-cookbooks/hadoop_cluster/recipes/secondarynamenode_only.rb
    	site-cookbooks/hadoop_cluster/recipes/std_hdfs_dirs.rb
    	site-cookbooks/hadoop_cluster/recipes/system_internals.rb
    	site-cookbooks/hadoop_cluster/recipes/update_apt.rb
    	site-cookbooks/hadoop_cluster/templates/default/apt-sources-cloudera.list.erb
    	site-cookbooks/hadoop_cluster/templates/default/hue.ini.erb
    	site-cookbooks/hadoop_cluster/templates/default/sources.list.d-cloudera.list.erb
    	site-cookbooks/hadoop_cluster/templates/default/webfront_index.html.erb
    	site-cookbooks/hbase/README.rdoc
    	site-cookbooks/hbase/attributes/hbase.rb
    	site-cookbooks/hbase/recipes/hbase_regionserver.rb
    	site-cookbooks/hbase/recipes/regionserver.rb
    	site-cookbooks/hbase/templates/default/export_hbase_tables.rb.erb
    	site-cookbooks/hive/README.rdoc
    	site-cookbooks/jruby/recipes/default.rb
    	site-cookbooks/jruby/recipes/gems.rb
    	site-cookbooks/nagios/libraries/default.rb
    	site-cookbooks/nfs/templates/default/fix_nfs_on_maverick_amis.sh
    	site-cookbooks/nodejs/README.rdoc
    	site-cookbooks/pig/attributes/pig.rb
    	site-cookbooks/pig/recipes/install_from_package.rb
    	site-cookbooks/python/attributes/default.rb
    	site-cookbooks/zookeeper/attributes/zookeeper.rb
    	site-cookbooks/zookeeper/recipes/default.rb
    	site-cookbooks/zookeeper/recipes/server.rb
    	site-cookbooks/zookeeper/recipes/zookeeper_server.rb
    	standard_cookbooks/boost/metadata.rb
    	standard_cookbooks/build-essential/README.md
    	standard_cookbooks/build-essential/recipes/default.rb
    	standard_cookbooks/runit/files/default/runsvdir
Commits on Feb 14, 2011
  1. added t1.micro to notes/ec2pricing

    Philip (flip) Kromer authored
Commits on Feb 10, 2011
  1. fixed conflict in ec2 pricing spreadsheet

    Philip (flip) Kromer authored
  2. added t1.micro to pricing

    Philip (flip) Kromer authored
Commits on Jan 27, 2011
  1. Updated ec2 pricing calcs

    Philip (flip) Kromer authored
Commits on Jan 26, 2011
  1. Pruned obsolete documentation

    Philip (flip) Kromer authored
Commits on Jan 24, 2011
  1. burning new AMI, getting cluster startup no-look

    Philip (flip) Kromer authored
Commits on Jan 21, 2011
  1. Updated java cookbook: now lets you set java flavor

    Philip (flip) Kromer authored
Commits on Jan 19, 2011
  1. Fixed a problem with hadoop service account creation

    Philip (flip) Kromer authored
Commits on Jan 18, 2011
  1. Fixed a problem with hadoop service account creation

    Philip (flip) Kromer authored
  2. HBase tuning

    Philip (flip) Kromer authored
Commits on Jan 13, 2011
  1. new AMIs

    Philip (flip) Kromer authored
Commits on Dec 24, 2010
  1. Finished Zookeeper & Hbase recipes

    Philip (flip) Kromer authored
  2. fixes to get hbase and zookeeper recipes working

    Philip (flip) Kromer authored
  3. Updated hadoop recipes to CHD3b3 -- necessitates changes to users and…

    Philip (flip) Kromer authored
    … permissions across the board
Commits on Aug 15, 2010
  1. added (awaiting testing) settings for min_split_size and daemon heap …

    Philip (flip) Kromer authored
    …size. Also, masters install pig too by default (in case they lack the worker role
Commits on Aug 14, 2010
  1. Reworked the hadoop performance settings. The number of map tasks is …

    Philip (flip) Kromer authored
    …now much more generous, to let you have room to run with map-side only jobs. This means there will typically be about 2.0 to 2.5 * cores number of tasktrackers running. The heap size however is now set based on an assumption that fewer than this number -- more like 1.5*cores -- will be sitting at the max heap level. You should use mapred.max.maps.per.node and mapred.max.reduces.per.node
Commits on Jul 30, 2010
  1. some notes in the how to patch hadoop the kludgey way

    Philip (flip) Kromer authored
Commits on Jul 26, 2010
  1. collected names for new AMIs

    Philip (flip) Kromer authored
Commits on Jul 25, 2010
  1. Motherfucking AMI hell. burn burn burn burn burn.

    Philip (flip) Kromer authored
  2. reverting to chef bootstrap

    Philip (flip) Kromer authored
Commits on Jul 7, 2010
  1. Fixes for CHD3 release of June 1st-ish

    Philip (flip) Kromer authored
Commits on Jun 27, 2010
  1. Added a note to the TODO, organized the pricing table

    Philip (flip) Kromer authored
  2. Filled out my version of the TODO

    Philip (flip) Kromer authored
Commits on Jun 24, 2010
  1. notes on ebs volumes, messily

    Philip (flip) Kromer authored
Commits on Jun 18, 2010
  1. Addded notes on making EBS volumes for HDFS

    Philip (flip) Kromer authored
Commits on Jun 17, 2010
  1. cassandra: oops on forcing the cluster name. hadoop: tweaked the clus…

    Philip (flip) Kromer authored
    …ter size vs. hadoop settings
Commits on Jun 13, 2010
  1. fixed a problem in cluster_service_discovery: ill-formed/missing valu…

    Philip (flip) Kromer authored
    …e kept anything from being found
Commits on Jun 12, 2010
  1. Some cassandra notes

    Philip (flip) Kromer authored
Commits on Jun 9, 2010
  1. zaius clouds

    Philip (flip) Kromer authored
  2. Burned a whole new round of AMIs

    Philip (flip) Kromer authored
Commits on Jun 8, 2010
  1. Pig recipes need JAVA_HOME set

    Philip (flip) Kromer authored
  2. fixed nil client-config in user-data boostrap scripts

    Philip (flip) Kromer authored
Something went wrong with that request. Please try again.