Permalink
Browse files

- Updated Docs for new skynet _install

- Updated README
- Changed some debugging statements
- rename ActiveRecord::Base.distributed_find.each to  ActiveRecord::Base.distributed_find.mapreduce

- Skynet now longer wants you to have a local launcher. Instead you just need a config/skynet_config.rb in your applications root.  The main launcher now looks for this file explicitly.
- The config file can also be specified with --config= to the manager or workers.
- skynet_install now only installs config/skynet_config.rb instead of script/skynet
- Installed rails environments/initializers/skynet.rb now just includes config/skynet_config.rb

- Removed old mysql skynet_worker_queues table stuff.

- Updated examples for new skynet_config and added MostCommonWord example in dgrep.

- Clean up skynet_manager and skynet_worker command line options.
  • Loading branch information...
1 parent 5bc022a commit e0f21542d2fbb44a2e49fd5d116887923c46b252 phlapjack committed May 28, 2008
Showing with 7,639 additions and 302 deletions.
  1. +11 −3 History.txt
  2. +14 −3 Manifest.txt
  3. +44 −38 README.txt
  4. +6 −7 app_generators/skynet_install/skynet_install_generator.rb
  5. +0 −23 app_generators/skynet_install/templates/migration.rb
  6. +0 −34 app_generators/skynet_install/templates/skynet
  7. +50 −0 app_generators/skynet_install/templates/skynet_config.rb
  8. +1 −9 app_generators/skynet_install/templates/skynet_initializer.rb
  9. +0 −23 app_generators/skynet_install/templates/skynet_mysql_schema.sql
  10. +38 −0 bin/skynet
  11. +5 −5 bin/skynet_install
  12. +12 −12 bin/skynet_tuplespace_server
  13. +23 −3 examples/dgrep/README
  14. +26 −0 examples/dgrep/config/skynet_config.rb
  15. +2 −0 examples/dgrep/data/shakespeare/README
  16. +381 −0 examples/dgrep/data/shakespeare/poetry/loverscomplaint
  17. +2,199 −0 examples/dgrep/data/shakespeare/poetry/rapeoflucrece
  18. +2,633 −0 examples/dgrep/data/shakespeare/poetry/sonnets
  19. +640 −0 examples/dgrep/data/shakespeare/poetry/various
  20. +1,423 −0 examples/dgrep/data/shakespeare/poetry/venusandadonis
  21. +8 −8 examples/dgrep/lib/most_common_words.rb
  22. +11 −11 examples/dgrep/script/dgrep
  23. +0 −18 examples/dgrep/script/skynet
  24. +2 −0 examples/rails_mysql_example/app/models/user.rb
  25. +1 −8 examples/rails_mysql_example/config/initializers/skynet.rb
  26. +36 −0 examples/rails_mysql_example/config/skynet_config.rb
  27. +1 −24 examples/rails_mysql_example/db/migrate/001_create_skynet_tables.rb
  28. +1 −24 examples/rails_mysql_example/db/skynet_mysql_schema.sql
  29. +1 −1 examples/rails_mysql_example/lib/tasks/rails_mysql_example.rake
  30. +0 −15 examples/rails_mysql_example/script/skynet
  31. +1 −1 lib/skynet.rb
  32. +2 −2 lib/skynet/skynet_active_record_extensions.rb
  33. +7 −7 lib/skynet/skynet_config.rb
  34. +3 −4 lib/skynet/skynet_launcher.rb
  35. +35 −14 lib/skynet/skynet_manager.rb
  36. +21 −4 lib/skynet/skynet_worker.rb
  37. +1 −1 website/index.html
View
@@ -2,7 +2,15 @@
Skynet::Manager and Skynet Script Runner
- Rewrote how Skynet workers and skynet manager talks on each machine. See below for more info
- - Support starting Skynet with ./script/skynet start and stop to daemonize
+ - Added an examples/ directory with sample skynet apps.
+
+ - Support starting Skynet with 'skynet start/stop' to daemonize
+ - skynet_install now only installs a config/skynet_config.rb in your applications directory. You are no longer supposed
+ to have a script/skynet to start skynet. Instead, as long as you have a config/skynet_config.rb you can just run
+ 'skynet start/stop' from within your application_directory/
+ If you're installing in a rails application, it will install a default config/initializers/skynet.rb which merely requires config/skynet_config.rb
+ - The config file can also be specified with --config= skynet start
+
- Gracefully handles trying to start skynet more than once
- Close file handles on exec.
Skynet::Worker and Skynet::Manager now call Skynet.fork_and_exec instead of their own versions.
@@ -19,6 +27,7 @@ Skynet::Manager and Skynet Script Runner
- Added printlog logging method which always prints to the log as [LOG]
- Deprecated Skynet.new to Skynet.start
- Mysql Message Queue Adapter - Make delete_expired_messages much safer.
+ - rename ActiveRecord::Base.distributed_find.each to ActiveRecord::Base.distributed_find.mapreduce
- ActiveRecord::Base.distributed_find - Patch submitted by Lourens Naude (lourens@methodmissing.com) which checks the model for the primary_key name as opposed to assuming it is
'id'
- We don't want to use rails constantize so I've temporarily borrowed the method from ActiveSupport inflector and added it to skynet_ruby_extensions.
@@ -30,8 +39,7 @@ Skynet::Manager and Skynet Script Runner
- Modified the skynet_install skynet runner to take skynet initializer into account
- Skynet::ActiveRecordExtensions Fixed a bug where it would fail if your table had fewer than 1000 rows. It performs a count
first now to make sure there are enough rows.
- - Introduced some new Skynet::Config methods for getting logfile and pidfile locations
-
+ - Introduced some new Skynet::Config methods for getting logfile and pidfile locations
Skynet Manager/Worker Refactor
The workers used to publish their worker statuses to the skynet_worker_queue which lived in the same Q space as the skynet_message_queue. skynet managers would then query that queue for their workers' statuses. This was a very inefficient use of central resources. NOW, workers communicate with their manager vir DRb, calling manager.worker_notify(status). This adds the worker status hash onto a local Queue object stored in the manager. A separate thread watches that queue and updates the internal manager information about it's workers. This was in place of polling a queue every N seconds for new worker records.
View
@@ -6,7 +6,7 @@ Rakefile
app_generators/skynet_install/USAGE
app_generators/skynet_install/skynet_install_generator.rb
app_generators/skynet_install/templates/migration.rb
-app_generators/skynet_install/templates/skynet
+app_generators/skynet_install/templates/skynet_config.rb
app_generators/skynet_install/templates/skynet_initializer.rb
app_generators/skynet_install/templates/skynet_mysql_schema.sql
bin/skynet
@@ -15,6 +15,13 @@ bin/skynet_tuplespace_server
config/hoe.rb
config/requirements.rb
examples/dgrep/README
+examples/dgrep/config/skynet_config.rb
+examples/dgrep/data/shakespeare/README
+examples/dgrep/data/shakespeare/poetry/loverscomplaint
+examples/dgrep/data/shakespeare/poetry/rapeoflucrece
+examples/dgrep/data/shakespeare/poetry/sonnets
+examples/dgrep/data/shakespeare/poetry/various
+examples/dgrep/data/shakespeare/poetry/venusandadonis
examples/dgrep/data/testfile1.txt
examples/dgrep/data/testfile2.txt
examples/dgrep/data/testfile3.txt
@@ -23,7 +30,6 @@ examples/dgrep/lib/dgrep.rb
examples/dgrep/lib/mapreduce_test.rb
examples/dgrep/lib/most_common_words.rb
examples/dgrep/script/dgrep
-examples/dgrep/script/skynet
examples/rails_mysql_example/README
examples/rails_mysql_example/Rakefile
examples/rails_mysql_example/app/controllers/application.rb
@@ -42,6 +48,7 @@ examples/rails_mysql_example/config/initializers/inflections.rb
examples/rails_mysql_example/config/initializers/mime_types.rb
examples/rails_mysql_example/config/initializers/skynet.rb
examples/rails_mysql_example/config/routes.rb
+examples/rails_mysql_example/config/skynet_config.rb
examples/rails_mysql_example/db/migrate/001_create_skynet_tables.rb
examples/rails_mysql_example/db/migrate/002_create_users.rb
examples/rails_mysql_example/db/migrate/003_create_user_favorites.rb
@@ -78,7 +85,6 @@ examples/rails_mysql_example/script/process/reaper
examples/rails_mysql_example/script/process/spawner
examples/rails_mysql_example/script/runner
examples/rails_mysql_example/script/server
-examples/rails_mysql_example/script/skynet
examples/rails_mysql_example/test/fixtures/user_favorites.yml
examples/rails_mysql_example/test/fixtures/users.yml
examples/rails_mysql_example/test/test_helper.rb
@@ -131,3 +137,8 @@ test/test_skynet_manager.rb
test/test_skynet_message.rb
test/test_skynet_task.rb
test/test_tuplespace_message_queue.rb
+website/index.html
+website/index.txt
+website/javascripts/rounded_corners_lite.inc.js
+website/stylesheets/screen.css
+website/template.rhtml
Oops, something went wrong.

0 comments on commit e0f2154

Please sign in to comment.