Skip to content

Commit

Permalink
updated performance now with brm and brp
Browse files Browse the repository at this point in the history
  • Loading branch information
erikfrey committed Mar 23, 2009
1 parent 7eef382 commit 8bd1abb
Showing 1 changed file with 3 additions and 3 deletions.
6 changes: 3 additions & 3 deletions README.textile
Expand Up @@ -8,11 +8,11 @@ bashreduce lets you apply your favorite unix tools in a mapreduce fashion across


h2. Configuration h2. Configuration


If you wish, you may edit @/etc/br.hosts@ and enter the machines you wish to use as workers. You can also specify this at runtime: Edit @/etc/br.hosts@ and enter the machines you wish to use as workers. Or specify your machines at runtime:


<pre>br -m "host1 host2 host3"</pre> <pre>br -m "host1 host2 host3"</pre>


To take advantage of multiple cores, repeat the host name as many times as you wish. To take advantage of multiple cores, repeat the host name.


h2. Examples h2. Examples


Expand All @@ -37,7 +37,7 @@ I have four compute machines and I'm usually relegated to using one core on one
|_. command |_. using |_. time |_. rate | |_. command |_. using |_. time |_. rate |
| sort -k1,1 4gb_file > 4gb_file_sorted | coreutils | 82m54.746s | 843 kBps | | sort -k1,1 4gb_file > 4gb_file_sorted | coreutils | 82m54.746s | 843 kBps |
| br -i 4gb_file -o 4gb_file_sorted | coreutils | 9m17.431s | 7.35 MBps | | br -i 4gb_file -o 4gb_file_sorted | coreutils | 9m17.431s | 7.35 MBps |
| br -i 4gb_file -o 4gb_file_sorted | coreutils, brp | 6m5.968s | 11.19 MBps | | br -i 4gb_file -o 4gb_file_sorted | brp/brm | 4m13.816s | 16.1376745 MBps |


When I have more time I'll compare this apples to apples. There's also still a ton of room for improvement. When I have more time I'll compare this apples to apples. There's also still a ton of room for improvement.


Expand Down

0 comments on commit 8bd1abb

Please sign in to comment.