Skip to content
John Langford's original release of Vowpal Wabbit -- a fast online learning algorithm
C++ C Perl Lua Shell
Pull request Compare This branch is 18 commits ahead, 5866 commits behind JohnLangford:master.
Latest commit f851b98 May 9, 2012 @clementfarabet Omitted.
Failed to load latest commit information.
cluster Fixed server install, as daemon Jan 23, 2012
online_cluster various cleanup and organization Aug 15, 2011
test removed rand() which changes across platforms. Bug from Frank Oct 17, 2011
utl - Added vw-convergence charting utility and a new 'utl' directory Nov 27, 2010
.gitignore Add more tests: 1) really test -q (was noop) 2) test threads Dec 9, 2010
CMakeLists.txt Upgraded install for torch-pkg May 7, 2012
FindTorch.cmake added missing torch finder. Oct 31, 2011
License.txt readded License.txt Nov 9, 2010
Makefile.origvowpal Protecting makefile Jan 23, 2012
README.md Fixed some bugs. May 7, 2012
accumulate.cc initial rewrite of spanning tree creation protocol Sep 3, 2011
accumulate.h add -std=c++0x and deal with all kinds of type and namespace issues Sep 1, 2011
active_interactor.cc persistent daemon should be working ... Aug 4, 2011
allreduce.cc debug new span server Sep 5, 2011
allreduce.h Smaller cache Oct 31, 2011
bfgs.cc better version of Lihong's patch Oct 24, 2011
bfgs.h per feature regularization for bfgs Aug 24, 2011
cache.cc add -std=c++0x and deal with all kinds of type and namespace issues Sep 1, 2011
cache.h made 29 bits correct and explicitly disabled greater. Jan 19, 2011
comp_io.h add -std=c++0x and deal with all kinds of type and namespace issues Sep 1, 2011
constant.h minor bugfixes Dec 5, 2009
delay_ring.cc variable ring_size and faster lda sort from Matt Sep 8, 2011
delay_ring.h fixed (hopefully) final threading bug from Nikos. Sep 26, 2010
example.h removed array Jun 26, 2011
gd.cc better version of Lihong's patch Oct 24, 2011
gd.h better version of Lihong's patch Oct 24, 2011
gd_mf.cc better version of Lihong's patch Oct 24, 2011
gd_mf.h added regularization for matrix factorization and R script for parame… Jun 16, 2011
global_data.cc revert lihongs patch which due to extra stuff Oct 24, 2011
global_data.h better version of Lihong's patch Oct 24, 2011
hash.cc Added attribution for murmurhash2 Dec 7, 2009
hash.h Initial release of version 3.10. I've incorporated some of the Jul 31, 2009
init.cpp Added accumulate+average. Oct 31, 2011
init.lua Fixed some bugs. May 7, 2012
io.cc revert lihongs patch which due to extra stuff Oct 24, 2011
io.h revert lihongs patch which due to extra stuff Oct 24, 2011
lda_core.cc revert lihongs patch which due to extra stuff Oct 24, 2011
lda_core.h various cleanup and organization Aug 16, 2011
loss_functions.cc revert lihongs patch which due to extra stuff Oct 24, 2011
loss_functions.h add -std=c++0x and deal with all kinds of type and namespace issues Sep 1, 2011
main.cc revert lihongs patch which due to extra stuff Oct 24, 2011
message_relay.cc fixed reset/daemon interaction bug Oct 19, 2010
message_relay.h finished implementing backprop, debugging Sep 4, 2010
multisource.cc remove variable length arrays Sep 19, 2011
multisource.h bug fixes from Nikos Sep 21, 2010
network.cc revert lihongs patch which due to extra stuff Oct 24, 2011
network.h revert lihongs patch which due to extra stuff Oct 24, 2011
noop.cc solved slow finishing bug Sep 17, 2010
noop.h Added support for noop when only caching. Sep 14, 2009
offset_tree.cc tweaking compile bugs Nov 29, 2009
parse_args.cc remove nonviable optimization methods from MF Oct 28, 2011
parse_args.h add -std=c++0x and deal with all kinds of type and namespace issues Sep 1, 2011
parse_example.cc revert lihongs patch which due to extra stuff Oct 24, 2011
parse_example.h add -std=c++0x and deal with all kinds of type and namespace issues Sep 1, 2011
parse_primitives.cc Initial release of version 3.10. I've incorporated some of the Jul 31, 2009
parse_primitives.h add -std=c++0x and deal with all kinds of type and namespace issues Sep 1, 2011
parse_regressor.cc revert lihongs patch which due to extra stuff Oct 24, 2011
parse_regressor.h deal with conflict Sep 1, 2011
parser.cc revert lihongs patch which due to extra stuff Oct 24, 2011
parser.h revert lihongs patch which due to extra stuff Oct 24, 2011
sender.cc revert lihongs patch which due to extra stuff Oct 24, 2011
sender.h add -std=c++0x and deal with all kinds of type and namespace issues Sep 1, 2011
simple_label.cc revert lihongs patch which due to extra stuff Oct 24, 2011
simple_label.h changed label to include an initial offset, allowing residual prediction Jun 25, 2011
sparse_dense.cc better version of Lihong's patch Oct 24, 2011
sparse_dense.h better version of Lihong's patch Oct 24, 2011
test.lua Omitted. May 9, 2012
unique_sort.cc deleted debian-specific and tweaked n/skip generation so it made sens… Apr 19, 2010
unique_sort.h deleted debian-specific and tweaked n/skip generation so it made sens… Apr 20, 2010
v_array.h add -std=c++0x and deal with all kinds of type and namespace issues Sep 1, 2011
vw.cc removed cg code Sep 15, 2011
vw.h First sending core. Aug 16, 2009

README.md

allreduce: a simple Lua wrapper around vowpal wabbit's allreduce implementation

This is a simple Lua interface to John Langford's allreduce implementation.

To use it, you simply neet to start a server on some arbitrary machine:

ssh mymachine
torch -lallreduce -e "allreduce.startserver()"

Once this daemon is running, you can run as many jobs as you like, on any machine, provided that you point to 'mymachine'.

From machine 1:

-- script 1:
allreduce.init('mymachine', 1, 2)  -- job 1/2
allreduce.average(somevector)

From machine 2:

-- script 2:
allreduce.init('mymachine', 2, 2)  -- job 2/2
allreduce.average(somevector)

After these calls, both scripts will have the same 'somevector'.

A test is provided in the source tree. After starting the server on 'localhost', you can run the test like this:

# process 1:
torch test.lua -id 1 -total 2

# process 2:
torch test.lua -id 2 -total 2

Install

Given a valid Torch7 install:

torch-pkg install allreduce

or, to retrieve the sources:

torch-pkg download allreduce
torch-pkg deploy allreduce

Copyrights

This is the vowpal wabbit fast online learning code. It is Copyright (c) 2009 Yahoo! Inc, and released for use under the BSD (revised) open source license.

Contributing authors are John Langford (Primary), Lihong Li, Alex Strehl, and Shubham Chopra, and Gordon Rios. This is the second VW release, and our intention is to create an open source project this time.

Checked into github with clone URL: git://github.com/JohnLangford/vowpal_wabbit.git

To get the code install git -- in a clean directory:

git clone git://github.com/JohnLangford/vowpal_wabbit.git

Gordon created a tag for the completely stock initial distribution '2.3' so to check out that original release and create a branch based on it:

git checkout 2.3 git checkout -b from-2.3

Or, in one command:

git checkout -b from-2.3 2.3

Swicegood, Travis. Pragmatic Version Control with Git. 2008. (p. 102)

Alternatively, the code can be downloaded directly from github:

http://github.com/gparker/vowpal_wabbit/downloads

Something went wrong with that request. Please try again.