686e6acb525f14cc15e016a4bcb73c3109fa13c6 Luke Kanies luke@madstop.com http://github.com/lak/puppet/commit/97294755a65c9c16226f5ef0d48f2a470987c2b8 97294755a65c9c16226f5ef0d48f2a470987c2b8 2009-04-14T10:13:03-07:00 2009-04-07T16:41:51-07:00 Removing unnecessary parser variables when yaml-dumping Also working around a YAML bug in Ruby. Signed-off-by: Luke Kanies <luke@madstop.com> a13bdcf9a975ea5be75bca7f98adc277cf1a4e5a Luke Kanies luke@madstop.com 7a7243d9f0e35298913a947f5d347d023b0bdb31 Ethan Rowe ethan@endpoint.com http://github.com/lak/puppet/commit/686e6acb525f14cc15e016a4bcb73c3109fa13c6 686e6acb525f14cc15e016a4bcb73c3109fa13c6 2009-04-13T04:46:53-07:00 2009-04-13T04:46:53-07:00 Add queue indirection as an option for catalog storage. This eventually will allow catalog storage ("storeconfigs") to be taken out of the critical request-handling path of puppetmasterd, such that: * Puppet::Node::Catalog can be serialized to a message queue via the indirector's "save" method * a separate process can use Puppet::Node::Catalog::Queue.subscribe to pick up these catalog objects as they come in and can save them to the database through the :active_record terminus b8d16abc9f9c138f04267a0b086a254f7802fbc0 Ethan Rowe ethan@endpoint.com 7da590ac8692b528c1239fd4234c23b6a52807cf Ethan Rowe ethan@endpoint.com http://github.com/lak/puppet/commit/7a7243d9f0e35298913a947f5d347d023b0bdb31 7a7243d9f0e35298913a947f5d347d023b0bdb31 2009-04-13T04:41:12-07:00 2009-04-13T04:41:12-07:00 Introduce abstract queue terminus within the indirection system. The queue abstract terminus allows the standard indirector behaviors to interact with a message queue broker, such that the indirector's "save" method writes the relevant model object out to a queue on the message broker. While the indirector's "find" method does not map to a message queue, the queue terminus class offers a "subscribe" method that allows for easy implementation of an event loop, receiving indirected objects saved to a queue as they come in. ce10b106fef4ca187bfdd44e8e04a63973d988b6 Ethan Rowe ethan@endpoint.com 447bb8f5017c87450aaf8733b6db5077f804e7f3 Ethan Rowe ethan@endpoint.com http://github.com/lak/puppet/commit/7da590ac8692b528c1239fd4234c23b6a52807cf 7da590ac8692b528c1239fd4234c23b6a52807cf 2009-04-13T04:33:11-07:00 2009-04-13T04:33:11-07:00 Introduce queue client "plugin" namespace and interface, with a Stomp client implementation. Puppet::Util::Queue provides queue client mix-in behaviors that enable easy queue client management for consumer classes. Some relevant behaviors include: * standard Puppet instance loader behavior for loading queue client modules on-demand based on the client module specified by symbolic name * singleton registry of known queue client types (based on symbol-to-class mappings from the instance loading behavior) * simple interface for working with an actual queue client instance Puppet::Util::Queue::Stomp wraps the Stomp::Client class to provide an initial queue client option supporting the Stomp messaging protocol. This defines the interface for all Puppet queue client plugins going forward. 1d6dc8713080d9d284a288020e70aef9bc1e0f11 Ethan Rowe ethan@endpoint.com 445937f0b9a846ae7ff10c75efbf7eba3d627f9b Luke Kanies luke@madstop.com http://github.com/lak/puppet/commit/447bb8f5017c87450aaf8733b6db5077f804e7f3 447bb8f5017c87450aaf8733b6db5077f804e7f3 2009-04-12T21:18:12-07:00 2009-04-12T21:17:41-07:00 Backporting the fix to #2111 here Signed-off-by: Luke Kanies <luke@madstop.com> 48b25b15f8e83501e022b3165dd5ad7ed5521948 Luke Kanies luke@madstop.com 817b3659c0054cc8c373151ca05b53b6e6defb4a Luke Kanies luke@madstop.com http://github.com/lak/puppet/commit/445937f0b9a846ae7ff10c75efbf7eba3d627f9b 445937f0b9a846ae7ff10c75efbf7eba3d627f9b 2009-04-11T19:06:14-07:00 2009-04-11T19:06:14-07:00 renaming a method Signed-off-by: Luke Kanies <luke@madstop.com> eb9a1ee7921e7b35c87e724883b65603acc557a2 Luke Kanies luke@madstop.com ce56b70b6032edc49f6c4732f8ab665d271af815 9316ef9ea9145e95fea9fa8bfeb389341fd8d1ec Luke Kanies luke@madstop.com http://github.com/lak/puppet/commit/817b3659c0054cc8c373151ca05b53b6e6defb4a 817b3659c0054cc8c373151ca05b53b6e6defb4a 2009-04-10T18:57:07-07:00 2009-04-10T18:57:07-07:00 Merge branch 'refactor/0.24.8/clean_storeconfigs_accumulator' into refactor/0.24.8/clean_storeconfigs_performance 6ed0f1fdccef05fcf66b076549e043bedc0a1eb4 Luke Kanies luke@madstop.com e22a7195225a75fe3aec5e401a253b1b7edc4302 Ethan Rowe ethan@endpoint.com http://github.com/lak/puppet/commit/9316ef9ea9145e95fea9fa8bfeb389341fd8d1ec 9316ef9ea9145e95fea9fa8bfeb389341fd8d1ec 2009-04-10T18:56:44-07:00 2009-04-10T13:01:25-07:00 Adjusted parameter name and puppet tag classes to use new cache accumulator behavior for storeconfigs. Removed per-class implementatiosn of accumulate_by_name from affected classes. 6ed0f1fdccef05fcf66b076549e043bedc0a1eb4 Luke Kanies luke@madstop.com ce56b70b6032edc49f6c4732f8ab665d271af815 Ethan Rowe ethan@endpoint.com http://github.com/lak/puppet/commit/e22a7195225a75fe3aec5e401a253b1b7edc4302 e22a7195225a75fe3aec5e401a253b1b7edc4302 2009-04-10T18:48:48-07:00 2009-04-06T08:34:12-07:00 Initial implementation of a "cache accumulator" behavior. Mix Puppet::Util::CacheAccumulator into an ActiveRecord-like class, and then for any attribute in that class on which you are likely to call find_or_create_by_*, specify: accumulates :foo and instead of :find_or_create_by_foo use :accumulate_by_foo. The class will cache known results keyed by values of :foo. Do an initial bulk-lookup: class.accumulate_by_foo('foo1', 'foo2', 'foo3', 'foo4') 6eb1094181f930e94564fee4eff20d8e54ce4e6a Luke Kanies luke@madstop.com 72344bf259e624d2e4ac94ef345fd3d97ffad97b d4b4029e8c27c0b95ea0319be86cdf0e5806eac6 Luke Kanies luke@madstop.com http://github.com/lak/puppet/commit/ce56b70b6032edc49f6c4732f8ab665d271af815 ce56b70b6032edc49f6c4732f8ab665d271af815 2009-04-10T18:47:38-07:00 2009-04-10T18:47:38-07:00 Merge branch 'refactor/0.24.8/clean_rails_refactor' into refactor/0.24.8/clean_storeconfigs_performance Conflicts: lib/puppet/indirector/catalog/active_record.rb lib/puppet/indirector/facts/active_record.rb spec/unit/indirector/catalog/active_record.rb spec/unit/indirector/facts/active_record.rb c71196a7bb0a6333a302f2be8d52ebb7f6b2bb9e Luke Kanies luke@madstop.com 7f4cbc197cc35b00348aaaea793c406de8ceaa5c Luke Kanies luke@madstop.com http://github.com/lak/puppet/commit/72344bf259e624d2e4ac94ef345fd3d97ffad97b 72344bf259e624d2e4ac94ef345fd3d97ffad97b 2009-04-10T18:35:42-07:00 2009-04-06T17:12:04-07:00 Switching to Indirected ActiveRecord This is mostly a configuration change, with some code getting removed. Signed-off-by: Luke Kanies <luke@madstop.com> 43caf2167fe535defe058a91af11671cc9dc39f9 Luke Kanies luke@madstop.com dbe717bc48002c87a6d2f18b8759116af51d590b Luke Kanies luke@madstop.com http://github.com/lak/puppet/commit/7f4cbc197cc35b00348aaaea793c406de8ceaa5c 7f4cbc197cc35b00348aaaea793c406de8ceaa5c 2009-04-10T18:35:42-07:00 2009-04-06T17:10:59-07:00 Adding ActiveRecord terminus classes for Catalog This provides the last piece of ActiveRecord integration. It's pretty much just pass-through and *only* works if you're storing Parser resources to the db. Signed-off-by: Luke Kanies <luke@madstop.com> 23603340fe67c6c769f8a2625b0ceaaeb9c9ba88 Luke Kanies luke@madstop.com 7bbbdde210c2f02d18a1c9187cb479a1a66541f6 Luke Kanies luke@madstop.com http://github.com/lak/puppet/commit/dbe717bc48002c87a6d2f18b8759116af51d590b dbe717bc48002c87a6d2f18b8759116af51d590b 2009-04-10T18:35:42-07:00 2009-04-06T14:38:14-07:00 Adding ActiveRecord terminus classes for Node and Facts. This is most of the way to replacing standard StoreConfigs integration with the Indirector. We still need to convert the Catalog and then change all of the integraiton points (which is mostly the 'store' call in the Compiler). Signed-off-by: Luke Kanies <luke@madstop.com> 3f9e3533c83829f2c2e8afe1aa7b4679e897b99e Luke Kanies luke@madstop.com 55048b3e2b61ae7c229daf9e39da958312870c6d Luke Kanies luke@madstop.com http://github.com/lak/puppet/commit/7bbbdde210c2f02d18a1c9187cb479a1a66541f6 7bbbdde210c2f02d18a1c9187cb479a1a66541f6 2009-04-10T18:35:41-07:00 2009-04-02T14:08:07-07:00 Fixing the ability to convert a catalog to contain TransObjects This is essentially redoing work that was done in master. Signed-off-by: Luke Kanies <luke@madstop.com> 9577944cd87d574331e51b98af2b9aa16285894f Luke Kanies luke@madstop.com 04bf6f38ebd91e2a15b95925660ee186cd8c535f Luke Kanies luke@madstop.com http://github.com/lak/puppet/commit/55048b3e2b61ae7c229daf9e39da958312870c6d 55048b3e2b61ae7c229daf9e39da958312870c6d 2009-04-10T18:35:41-07:00 2009-04-02T13:53:59-07:00 Fixing catalog serialization. This is essentially backported from master and should hopefully merge cleanly against it. Signed-off-by: Luke Kanies <luke@madstop.com> 692de75c05cb159ed8a3f0aace3c15a588683687 Luke Kanies luke@madstop.com 87846bc490542d048fa640efb56b9fc27beb9b75 Luke Kanies luke@madstop.com http://github.com/lak/puppet/commit/04bf6f38ebd91e2a15b95925660ee186cd8c535f 04bf6f38ebd91e2a15b95925660ee186cd8c535f 2009-04-10T18:35:41-07:00 2009-04-08T17:45:59-07:00 Modifying the Settings#handlearg prototype I'd made the argument no longer optional because I thought the method was rarely used, but it's used in puppetd a good bit. Signed-off-by: Luke Kanies <luke@madstop.com> f919b630167fbafbb3c3cb302e3e2f8b1cf7d4be Luke Kanies luke@madstop.com 9a7b49d45c0244998c0866404c0d5b9f5db2febf Luke Kanies luke@madstop.com http://github.com/lak/puppet/commit/87846bc490542d048fa640efb56b9fc27beb9b75 87846bc490542d048fa640efb56b9fc27beb9b75 2009-04-10T18:35:41-07:00 2009-04-06T16:56:27-07:00 Adding a common Settings method for setting values We were previously missing some hooks for settings set via the command-line, because different code paths were being used. Signed-off-by: Luke Kanies <luke@madstop.com> 33daf79a2c69ff321d853f702e25dce940ca0880 Luke Kanies luke@madstop.com b293661f2bc84799bb50fbbee6ce3f1111d00ec9 Luke Kanies luke@madstop.com http://github.com/lak/puppet/commit/9a7b49d45c0244998c0866404c0d5b9f5db2febf 9a7b49d45c0244998c0866404c0d5b9f5db2febf 2009-04-10T18:35:41-07:00 2009-04-02T17:34:38-07:00 Fixing Rakefile; apparently there was a rake or gem incompatibility Signed-off-by: Luke Kanies <luke@madstop.com> 14dd949b014f6cd5f786c829c512145b48d201ac Luke Kanies luke@madstop.com 398b8e1bd04c0c87b862235020fa0f8f8b35e1e2 James Turnbull james@lovedthanlost.net http://github.com/lak/puppet/commit/b293661f2bc84799bb50fbbee6ce3f1111d00ec9 b293661f2bc84799bb50fbbee6ce3f1111d00ec9 2009-04-10T18:35:40-07:00 2009-03-20T02:34:13-07:00 Updated lib install permissions to 0644 0a166d7d98b54c38f62cfd88f0fdae1452fbd7f2 Luke Kanies luke@madstop.com 4b279fc3888d34e0b74edadc7723db04c625509f Ethan Rowe ethan@endpoint.com http://github.com/lak/puppet/commit/398b8e1bd04c0c87b862235020fa0f8f8b35e1e2 398b8e1bd04c0c87b862235020fa0f8f8b35e1e2 2009-04-10T18:35:40-07:00 2009-04-04T14:40:08-07:00 Add @options to test run call, for compatibility with more recent rspec versions. 3eee588d9a1fc65fb5c80637592dca8eda9c75d9 Luke Kanies luke@madstop.com 5de6d0e9efb356cb5a4756e81553dfca6544a589 James Turnbull james@lovedthanlost.net http://github.com/lak/puppet/commit/4b279fc3888d34e0b74edadc7723db04c625509f 4b279fc3888d34e0b74edadc7723db04c625509f 2009-04-10T18:35:40-07:00 2009-04-05T19:36:16-07:00 Fixed rspec gem at version 1.2.2 e4c9b00f54437399b2bd77044c84fae60e41042a Luke Kanies luke@madstop.com 02a503f4354b3397d584c3344ee0dbd86603374b Luke Kanies luke@madstop.com http://github.com/lak/puppet/commit/5de6d0e9efb356cb5a4756e81553dfca6544a589 5de6d0e9efb356cb5a4756e81553dfca6544a589 2009-04-10T18:35:40-07:00 2009-04-08T18:17:27-07:00 Fixing failing tests. Most of these are back-ports from master. Signed-off-by: Luke Kanies <luke@madstop.com> e50cc915aec2e3247896c4e5933e02d5b6a566d7 Luke Kanies luke@madstop.com 96336a7306ae3b6075ad7be88b6498422bf0ec2a Luke Kanies luke@madstop.com http://github.com/lak/puppet/commit/d4b4029e8c27c0b95ea0319be86cdf0e5806eac6 d4b4029e8c27c0b95ea0319be86cdf0e5806eac6 2009-04-10T16:27:46-07:00 2009-04-09T19:18:28-07:00 Saving rails resources as I create them, which saves about 10% Signed-off-by: Luke Kanies <luke@madstop.com> f7433b5ceebe0154f875e131b9bbd16882237882 Luke Kanies luke@madstop.com 5fcc5e73b709b9640091ef6d7684bccf2d9f434f Luke Kanies luke@madstop.com http://github.com/lak/puppet/commit/96336a7306ae3b6075ad7be88b6498422bf0ec2a 96336a7306ae3b6075ad7be88b6498422bf0ec2a 2009-04-10T16:27:45-07:00 2009-04-09T15:43:17-07:00 Changing rails value serialization to deal with booleans The database was automatically converting booleans to strings, and value comparison was not working correctly as a result. Signed-off-by: Luke Kanies <luke@madstop.com> f6048f4ff45cebe17a8e7e3d618e3bd71667610d Luke Kanies luke@madstop.com 8d8020ad23b8b3657417e964b77a19dfa4aae611 Luke Kanies luke@madstop.com http://github.com/lak/puppet/commit/5fcc5e73b709b9640091ef6d7684bccf2d9f434f 5fcc5e73b709b9640091ef6d7684bccf2d9f434f 2009-04-10T16:27:45-07:00 2009-04-09T15:31:39-07:00 Adding equality to ResourceReference This is used by the Parser subclass when testing equality with db-backed references. Signed-off-by: Luke Kanies <luke@madstop.com> 4f3f09326617a887c2532fbd0c50edafe88d0cee Luke Kanies luke@madstop.com 2032782153d42f7f9a403f851391b0e99e80f22a Luke Kanies luke@madstop.com http://github.com/lak/puppet/commit/8d8020ad23b8b3657417e964b77a19dfa4aae611 8d8020ad23b8b3657417e964b77a19dfa4aae611 2009-04-10T16:27:40-07:00 2009-04-08T16:47:26-07:00 Adding some more fine-grained benchmarks to Rails support Signed-off-by: Luke Kanies <luke@madstop.com> f7b903b7e2217386431acc1571f31611d79a8392 Luke Kanies luke@madstop.com 92a76630eed82bb6e2e46c7db9aa994ce11f4738 Luke Kanies luke@madstop.com http://github.com/lak/puppet/commit/2032782153d42f7f9a403f851391b0e99e80f22a 2032782153d42f7f9a403f851391b0e99e80f22a 2009-04-10T16:26:32-07:00 2009-04-08T16:26:36-07:00 Adding a Rails-specific benchmarking module This just slightly simplifies adding lots of time-debug stuff in Rails. Signed-off-by: Luke Kanies <luke@madstop.com> e685afa8fa7e50796464f125e48a91555de8d47e Luke Kanies luke@madstop.com 48503e41024886914dbb498ce38cef247c6ec59d Luke Kanies luke@madstop.com http://github.com/lak/puppet/commit/92a76630eed82bb6e2e46c7db9aa994ce11f4738 92a76630eed82bb6e2e46c7db9aa994ce11f4738 2009-04-10T16:25:19-07:00 2009-04-08T16:05:34-07:00 Adding simplistic param_name/puppet_tag caching This has a drastic affect on performance - cuts about 25% off of the store time. Signed-off-by: Luke Kanies <luke@madstop.com> 062658b2e7e494992667250231d6f54340871274 Luke Kanies luke@madstop.com 8e0e38b69930626a7c6c410bc4c0b8719095eb30 Luke Kanies luke@madstop.com http://github.com/lak/puppet/commit/48503e41024886914dbb498ce38cef247c6ec59d 48503e41024886914dbb498ce38cef247c6ec59d 2009-04-10T16:20:59-07:00 2009-04-08T15:45:24-07:00 Adding more time debugging to Rails code, and refactoring a bit There is an accumulation in the resource tags (hackish enough but soon to be replaced), and I've fixed a small bug in the tags merging that was causing lots of extra work (like 3x). Signed-off-by: Luke Kanies <luke@madstop.com> 56adc7c4721abf34f3817b717d28a6d7f451d95c Luke Kanies luke@madstop.com bbee62fc17ef4d0ced0c1cc74c77bb87399b38bc Luke Kanies luke@madstop.com http://github.com/lak/puppet/commit/8e0e38b69930626a7c6c410bc4c0b8719095eb30 8e0e38b69930626a7c6c410bc4c0b8719095eb30 2009-04-10T16:18:57-07:00 2009-04-08T14:56:41-07:00 Refactoring the Rails integration This moves all code from the Parser class into the ActiveRecord classes, and gets rid of 'ar_hash_merge'. Signed-off-by: Luke Kanies <luke@madstop.com> 3b478b3af4f04ac9412edda44c66fdc221a4219a Luke Kanies luke@madstop.com