6936b2acf1391c9226d4063c9336b5ea47e659df 87497a99f178608ab3caa48741238d265bfa0375 David Hall dlwh@stanford.edu http://github.com/dlwh/smr/commit/2fae5645bc20e972a1dec6d0f8a78233becb2134 2fae5645bc20e972a1dec6d0f8a78233becb2134 2008-09-24T16:03:32-07:00 2008-09-24T16:03:32-07:00 Merge git@github.com:dlwh/smr 0955ca744a47f2d297ad99b126cac924764e57ee David Hall dlwh@stanford.edu 99ca858326331c9dd948df7f7681da3b2bb640a1 dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463 http://github.com/dlwh/smr/commit/6936b2acf1391c9226d4063c9336b5ea47e659df 6936b2acf1391c9226d4063c9336b5ea47e659df 2008-09-24T15:22:44-07:00 2008-09-24T15:22:44-07:00 New hadoop doesn't suck as much wrt generics. git-svn-id: svn+ssh://jamie.stanford.edu//u/nlp/svnroot/trunk/scalanlp/projects/smr@22769 c9c46bb1-2420-0410-b6d5-8c78f6715463 0955ca744a47f2d297ad99b126cac924764e57ee dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463 8a67a46628a15aa3a4555f7d42626719248997e8 dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463 http://github.com/dlwh/smr/commit/99ca858326331c9dd948df7f7681da3b2bb640a1 99ca858326331c9dd948df7f7681da3b2bb640a1 2008-09-24T15:13:18-07:00 2008-09-24T15:13:18-07:00 Re-added support for delete on exit. git-svn-id: svn+ssh://jamie.stanford.edu//u/nlp/svnroot/trunk/scalanlp/projects/smr@22768 c9c46bb1-2420-0410-b6d5-8c78f6715463 7a2a1aadc179426c4a6ffd768bb77e097cd088ef dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463 0c1389651c4f194fe6759a7c5165d998e666c980 dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463 http://github.com/dlwh/smr/commit/8a67a46628a15aa3a4555f7d42626719248997e8 8a67a46628a15aa3a4555f7d42626719248997e8 2008-09-24T15:10:30-07:00 2008-09-24T15:10:30-07:00 Lots of changes: Created something that allows arbitrary serialization of Serializable classes. Better support for real distribution git-svn-id: svn+ssh://jamie.stanford.edu//u/nlp/svnroot/trunk/scalanlp/projects/smr@22767 c9c46bb1-2420-0410-b6d5-8c78f6715463 83c51dc3cdc6300175dac424a24adf1469a29996 dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463 916ed32381b7d3f84ce2d225053f2c9051c4c437 dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463 http://github.com/dlwh/smr/commit/0c1389651c4f194fe6759a7c5165d998e666c980 0c1389651c4f194fe6759a7c5165d998e666c980 2008-09-24T15:00:33-07:00 2008-09-24T15:00:33-07:00 Examples git-svn-id: svn+ssh://jamie.stanford.edu//u/nlp/svnroot/trunk/scalanlp/projects/smr@22766 c9c46bb1-2420-0410-b6d5-8c78f6715463 91bfb0a9b51604a2f2bc342b394ceb75a669e5c2 dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463 7e0780d16c9f9fdac6abf5c02550af9591d2d49a dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463 http://github.com/dlwh/smr/commit/916ed32381b7d3f84ce2d225053f2c9051c4c437 916ed32381b7d3f84ce2d225053f2c9051c4c437 2008-09-24T14:59:01-07:00 2008-09-24T14:59:01-07:00 Added an abstract class to make case classes (and others) more easily Comparable git-svn-id: svn+ssh://jamie.stanford.edu//u/nlp/svnroot/trunk/scalanlp/projects/smr@22765 c9c46bb1-2420-0410-b6d5-8c78f6715463 447faf5fd19c261a5538bb6b419c3a4c7c678bc4 dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463 131484c5e210d60686e3021b6ea84cc15e139b85 dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463 http://github.com/dlwh/smr/commit/7e0780d16c9f9fdac6abf5c02550af9591d2d49a 7e0780d16c9f9fdac6abf5c02550af9591d2d49a 2008-09-21T12:04:16-07:00 2008-09-21T12:04:16-07:00 Added ++ to PathPairs, refactoring. git-svn-id: svn+ssh://jamie.stanford.edu//u/nlp/svnroot/trunk/scalanlp/projects/smr@22675 c9c46bb1-2420-0410-b6d5-8c78f6715463 1a71a5a5912c6771285df19dddf2cd5af1acaf68 dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463 78045519ea89c19026f608ee6bbe516aaa90b150 dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463 http://github.com/dlwh/smr/commit/131484c5e210d60686e3021b6ea84cc15e139b85 131484c5e210d60686e3021b6ea84cc15e139b85 2008-09-20T13:18:28-07:00 2008-09-20T13:18:28-07:00 utilities. git-svn-id: svn+ssh://jamie.stanford.edu//u/nlp/svnroot/trunk/scalanlp/projects/smr@22660 c9c46bb1-2420-0410-b6d5-8c78f6715463 09742a30461593d501e35de4e75117d00cbb33e6 dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463 38b66f9414c425b529a105756d8a950420819ec7 dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463 http://github.com/dlwh/smr/commit/78045519ea89c19026f608ee6bbe516aaa90b150 78045519ea89c19026f608ee6bbe516aaa90b150 2008-09-19T11:36:53-07:00 2008-09-19T11:36:53-07:00 We're running hadoop 0.17, not 0.18. Fixed compile errors. git-svn-id: svn+ssh://jamie.stanford.edu//u/nlp/svnroot/trunk/scalanlp/projects/smr@22634 c9c46bb1-2420-0410-b6d5-8c78f6715463 ce74b3d5a62b72232b39a1d7384ad2a4d17508bc dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463 66910539251a3453c47f265e6600a8f8701592e5 dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463 http://github.com/dlwh/smr/commit/38b66f9414c425b529a105756d8a950420819ec7 38b66f9414c425b529a105756d8a950420819ec7 2008-09-19T00:56:05-07:00 2008-09-19T00:56:05-07:00 Added a way to automatically distribute pairs. git-svn-id: svn+ssh://jamie.stanford.edu//u/nlp/svnroot/trunk/scalanlp/projects/smr@22624 c9c46bb1-2420-0410-b6d5-8c78f6715463 35dda17edb5a0d5fca03f79124371ebc01955574 dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463 10c887c962358b7b2f79d57ecd31e4d65a668781 dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463 http://github.com/dlwh/smr/commit/66910539251a3453c47f265e6600a8f8701592e5 66910539251a3453c47f265e6600a8f8701592e5 2008-09-19T00:56:00-07:00 2008-09-19T00:56:00-07:00 Additional implicit conversions git-svn-id: svn+ssh://jamie.stanford.edu//u/nlp/svnroot/trunk/scalanlp/projects/smr@22623 c9c46bb1-2420-0410-b6d5-8c78f6715463 f37b405da1030bf0f377bb14ca2d8c506e36d6e3 dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463 a284970d51a729c37fa764463ab40f2e0def9d2d f6b4ac2f848a21fc8057855a0c2105f954dceabd David Hall dlwh@stanford.edu http://github.com/dlwh/smr/commit/87497a99f178608ab3caa48741238d265bfa0375 87497a99f178608ab3caa48741238d265bfa0375 2008-09-12T16:47:55-07:00 2008-09-12T16:47:55-07:00 Merge git@github.com:dlwh/smr e9f3cd92bc15de1268ef522a3e53fde9197c11e7 David Hall dlwh@stanford.edu 15e5b7f5425f77209d19f044d9adf9f00023e6df dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463 http://github.com/dlwh/smr/commit/10c887c962358b7b2f79d57ecd31e4d65a668781 10c887c962358b7b2f79d57ecd31e4d65a668781 2008-09-12T10:49:44-07:00 2008-09-12T10:49:44-07:00 ? git-svn-id: svn+ssh://jamie.stanford.edu//u/nlp/svnroot/trunk/scalanlp/projects/smr@22526 c9c46bb1-2420-0410-b6d5-8c78f6715463 d1df8a5a73fe1845bd00a650ee568b6f167f0ba0 dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463 629d9fb1d6f62bf58fbade0ecc9b69c18854edcb dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463 http://github.com/dlwh/smr/commit/a284970d51a729c37fa764463ab40f2e0def9d2d a284970d51a729c37fa764463ab40f2e0def9d2d 2008-09-12T10:49:44-07:00 2008-09-12T10:49:44-07:00 ? git-svn-id: svn+ssh://jamie.stanford.edu/u/nlp/svnroot/trunk/scalanlp/projects/smr@22526 c9c46bb1-2420-0410-b6d5-8c78f6715463 d1df8a5a73fe1845bd00a650ee568b6f167f0ba0 dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463 55040ef8898d55357ecd37ae22a88bc4e94b9b56 David Hall dlwh@stanford.edu http://github.com/dlwh/smr/commit/f6b4ac2f848a21fc8057855a0c2105f954dceabd f6b4ac2f848a21fc8057855a0c2105f954dceabd 2008-09-12T10:48:07-07:00 2008-09-12T02:06:37-07:00 SMR: Delete non-staged files unless an option is set. Only on exit. e9f3cd92bc15de1268ef522a3e53fde9197c11e7 David Hall dlwh@stanford.edu 4de2390e2404c92b8e7515dc45ab621d5b0d040e David Hall dlwh@stanford.edu http://github.com/dlwh/smr/commit/55040ef8898d55357ecd37ae22a88bc4e94b9b56 55040ef8898d55357ecd37ae22a88bc4e94b9b56 2008-09-12T01:00:17-07:00 2008-09-12T01:00:17-07:00 Preliminary support for stages of computation. 9236b25e53c3b94d65cdd7665c9dea259892ee79 David Hall dlwh@stanford.edu 629d9fb1d6f62bf58fbade0ecc9b69c18854edcb ff92d39c4fa2ad35b05901e405c0dd4a9ce01995 David Hall dlwh@stanford.edu http://github.com/dlwh/smr/commit/4de2390e2404c92b8e7515dc45ab621d5b0d040e 4de2390e2404c92b8e7515dc45ab621d5b0d040e 2008-09-11T20:21:53-07:00 2008-09-11T20:21:53-07:00 Merge git@github.com:dlwh/smr 41468ba03c63d9b5cd007c9968c6d0bacbfb02b0 David Hall dlwh@stanford.edu d7dbb2f2f10fa87d023ee59cc4052b4eefa733d9 dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463 http://github.com/dlwh/smr/commit/15e5b7f5425f77209d19f044d9adf9f00023e6df 15e5b7f5425f77209d19f044d9adf9f00023e6df 2008-09-11T17:32:13-07:00 2008-09-11T17:32:13-07:00 deleteing again. git-svn-id: svn+ssh://jamie.stanford.edu//u/nlp/svnroot/trunk/scalanlp/projects/smr@22515 c9c46bb1-2420-0410-b6d5-8c78f6715463 41468ba03c63d9b5cd007c9968c6d0bacbfb02b0 dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463 dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463 http://github.com/dlwh/smr/commit/629d9fb1d6f62bf58fbade0ecc9b69c18854edcb 629d9fb1d6f62bf58fbade0ecc9b69c18854edcb 2008-09-11T17:32:13-07:00 2008-09-11T17:32:13-07:00 deleteing again. git-svn-id: svn+ssh://jamie.stanford.edu/u/nlp/svnroot/trunk/scalanlp/projects/smr@22515 c9c46bb1-2420-0410-b6d5-8c78f6715463 41468ba03c63d9b5cd007c9968c6d0bacbfb02b0 dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463 bf93504433093b8cc727fcd522865d65ef49b5e1 eb17f3f2ff704c67b7a1f463bd95ef9b5e2ab8cc dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463 http://github.com/dlwh/smr/commit/d7dbb2f2f10fa87d023ee59cc4052b4eefa733d9 d7dbb2f2f10fa87d023ee59cc4052b4eefa733d9 2008-09-11T17:32:09-07:00 2008-09-11T17:32:09-07:00 Merge git@github.com:dlwh/smr git-svn-id: svn+ssh://jamie.stanford.edu//u/nlp/svnroot/trunk/scalanlp/projects/smr@22514 c9c46bb1-2420-0410-b6d5-8c78f6715463 80a2dc6099108896608f53c06c6ff385b3e01afb dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463 3db7a1282a71c8a7bcf446d62a79e22ce1e9f5d9 David Hall dlwh@stanford.edu http://github.com/dlwh/smr/commit/ff92d39c4fa2ad35b05901e405c0dd4a9ce01995 ff92d39c4fa2ad35b05901e405c0dd4a9ce01995 2008-09-11T17:31:49-07:00 2008-09-11T17:31:49-07:00 deleteing again. 41468ba03c63d9b5cd007c9968c6d0bacbfb02b0 David Hall dlwh@stanford.edu bf93504433093b8cc727fcd522865d65ef49b5e1 eb17f3f2ff704c67b7a1f463bd95ef9b5e2ab8cc David Hall dlwh@stanford.edu http://github.com/dlwh/smr/commit/3db7a1282a71c8a7bcf446d62a79e22ce1e9f5d9 3db7a1282a71c8a7bcf446d62a79e22ce1e9f5d9 2008-09-11T17:31:25-07:00 2008-09-11T17:31:25-07:00 Merge git@github.com:dlwh/smr 80a2dc6099108896608f53c06c6ff385b3e01afb David Hall dlwh@stanford.edu b174e2ddd6531e8ad31d8f73fc4a6882bbd4512f dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463 http://github.com/dlwh/smr/commit/bf93504433093b8cc727fcd522865d65ef49b5e1 bf93504433093b8cc727fcd522865d65ef49b5e1 2008-09-11T17:30:33-07:00 2008-09-11T17:30:33-07:00 deleted an old dir. git-svn-id: svn+ssh://jamie.stanford.edu//u/nlp/svnroot/trunk/scalanlp/projects/smr@22513 c9c46bb1-2420-0410-b6d5-8c78f6715463 41468ba03c63d9b5cd007c9968c6d0bacbfb02b0 dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463 a8c73a429bc4e976427b32dbbb7b0604ac781f75 77dc6bd1b0ad8de49e3392a4efe41da6106ded3b David Hall dlwh@stanford.edu http://github.com/dlwh/smr/commit/eb17f3f2ff704c67b7a1f463bd95ef9b5e2ab8cc eb17f3f2ff704c67b7a1f463bd95ef9b5e2ab8cc 2008-09-05T02:10:56-07:00 2008-09-05T02:10:56-07:00 Merge git@github.com:dlwh/smr 80a2dc6099108896608f53c06c6ff385b3e01afb David Hall dlwh@stanford.edu dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463 http://github.com/dlwh/smr/commit/b174e2ddd6531e8ad31d8f73fc4a6882bbd4512f b174e2ddd6531e8ad31d8f73fc4a6882bbd4512f 2008-09-05T02:09:16-07:00 2008-09-05T02:09:16-07:00 wtf git-svn-id: svn+ssh://jamie.stanford.edu//u/nlp/svnroot/trunk/scalanlp/projects/smr@22413 c9c46bb1-2420-0410-b6d5-8c78f6715463 80a2dc6099108896608f53c06c6ff385b3e01afb dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463 3be0f07cb7f89bf0177f997894d3e530a5005303 dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463 http://github.com/dlwh/smr/commit/a8c73a429bc4e976427b32dbbb7b0604ac781f75 a8c73a429bc4e976427b32dbbb7b0604ac781f75 2008-09-05T02:09:16-07:00 2008-09-05T02:09:16-07:00 wtf git-svn-id: svn+ssh://jacob.stanford.edu/u/nlp/svnroot/trunk/scalanlp/projects/smr@22413 c9c46bb1-2420-0410-b6d5-8c78f6715463 80a2dc6099108896608f53c06c6ff385b3e01afb dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463 df84d2fd32bba829fac146b275944755ac80aa5b dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463 http://github.com/dlwh/smr/commit/3be0f07cb7f89bf0177f997894d3e530a5005303 3be0f07cb7f89bf0177f997894d3e530a5005303 2008-09-05T02:09:12-07:00 2008-09-05T02:09:12-07:00 added some utilty functions for map and reduce. git-svn-id: svn+ssh://jacob.stanford.edu/u/nlp/svnroot/trunk/scalanlp/projects/smr@22412 c9c46bb1-2420-0410-b6d5-8c78f6715463 e2df2f56887afe6c78f951d0bb61030c406d50b8 dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463 c75be8e44d707fd4cfd8dc744ee1612089e62abe dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463 http://github.com/dlwh/smr/commit/df84d2fd32bba829fac146b275944755ac80aa5b df84d2fd32bba829fac146b275944755ac80aa5b 2008-09-05T02:09:07-07:00 2008-09-05T02:09:07-07:00 Deleted Serialized from SMR. Not as useful with the plugin. git-svn-id: svn+ssh://jacob.stanford.edu/u/nlp/svnroot/trunk/scalanlp/projects/smr@22411 c9c46bb1-2420-0410-b6d5-8c78f6715463 6eb83dc3ba28d86d2bc995a1df89ab6a3635d220 dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463 de934487d820484fb28481ce4446e82cf7264908 dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463 http://github.com/dlwh/smr/commit/c75be8e44d707fd4cfd8dc744ee1612089e62abe c75be8e44d707fd4cfd8dc744ee1612089e62abe 2008-09-05T02:09:03-07:00 2008-09-05T02:09:03-07:00 Renamed hreduce to flatReduce, and made reduce in DistributedPairs more like Hadoop reduce. git-svn-id: svn+ssh://jacob.stanford.edu/u/nlp/svnroot/trunk/scalanlp/projects/smr@22410 c9c46bb1-2420-0410-b6d5-8c78f6715463 b4f8d65d8763590d6ba875b9101aca41453d1e9d dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463 2a11fd0ff27421d5a20ea34ad1185e8d826f588f dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463 http://github.com/dlwh/smr/commit/de934487d820484fb28481ce4446e82cf7264908 de934487d820484fb28481ce4446e82cf7264908 2008-09-05T02:08:58-07:00 2008-09-05T02:08:58-07:00 Deleted Serialized from SMR. Not as useful with the plugin. git-svn-id: svn+ssh://jacob.stanford.edu/u/nlp/svnroot/trunk/scalanlp/projects/smr@22409 c9c46bb1-2420-0410-b6d5-8c78f6715463 0f387ffbb75c49f5108b0a5c7991ea0516bed256 dlwh dlwh@c9c46bb1-2420-0410-b6d5-8c78f6715463