Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with
or
.
Download ZIP
John Langford's original release of Vowpal Wabbit -- a fast online learning algorithm
C++ C Perl Lua Shell
Branch: master
Pull request Compare This branch is 18 commits ahead, 4406 commits behind JohnLangford:master.
Failed to load latest commit information.
cluster Fixed server install, as daemon
online_cluster various cleanup and organization
test removed rand() which changes across platforms. Bug from Frank
utl - Added vw-convergence charting utility and a new 'utl' directory
.gitignore Add more tests: 1) really test -q (was noop) 2) test threads
CMakeLists.txt Upgraded install for torch-pkg
FindTorch.cmake added missing torch finder.
License.txt readded License.txt
Makefile.origvowpal Protecting makefile
README.md Fixed some bugs.
accumulate.cc initial rewrite of spanning tree creation protocol
accumulate.h add -std=c++0x and deal with all kinds of type and namespace issues
active_interactor.cc persistent daemon should be working ...
allreduce.cc debug new span server
allreduce.h Smaller cache
bfgs.cc better version of Lihong's patch
bfgs.h per feature regularization for bfgs
cache.cc add -std=c++0x and deal with all kinds of type and namespace issues
cache.h made 29 bits correct and explicitly disabled greater.
comp_io.h add -std=c++0x and deal with all kinds of type and namespace issues
constant.h minor bugfixes
delay_ring.cc variable ring_size and faster lda sort from Matt
delay_ring.h fixed (hopefully) final threading bug from Nikos.
example.h removed array
gd.cc better version of Lihong's patch
gd.h better version of Lihong's patch
gd_mf.cc better version of Lihong's patch
gd_mf.h added regularization for matrix factorization and R script for parame…
global_data.cc revert lihongs patch which due to extra stuff
global_data.h better version of Lihong's patch
hash.cc Added attribution for murmurhash2
hash.h Initial release of version 3.10. I've incorporated some of the
init.cpp Added accumulate+average.
init.lua Fixed some bugs.
io.cc revert lihongs patch which due to extra stuff
io.h revert lihongs patch which due to extra stuff
lda_core.cc revert lihongs patch which due to extra stuff
lda_core.h various cleanup and organization
loss_functions.cc revert lihongs patch which due to extra stuff
loss_functions.h add -std=c++0x and deal with all kinds of type and namespace issues
main.cc revert lihongs patch which due to extra stuff
message_relay.cc fixed reset/daemon interaction bug
message_relay.h finished implementing backprop, debugging
multisource.cc remove variable length arrays
multisource.h bug fixes from Nikos
network.cc revert lihongs patch which due to extra stuff
network.h revert lihongs patch which due to extra stuff
noop.cc solved slow finishing bug
noop.h Added support for noop when only caching.
offset_tree.cc tweaking compile bugs
parse_args.cc remove nonviable optimization methods from MF
parse_args.h add -std=c++0x and deal with all kinds of type and namespace issues
parse_example.cc revert lihongs patch which due to extra stuff
parse_example.h add -std=c++0x and deal with all kinds of type and namespace issues
parse_primitives.cc Initial release of version 3.10. I've incorporated some of the
parse_primitives.h add -std=c++0x and deal with all kinds of type and namespace issues
parse_regressor.cc revert lihongs patch which due to extra stuff
parse_regressor.h deal with conflict
parser.cc revert lihongs patch which due to extra stuff
parser.h revert lihongs patch which due to extra stuff
sender.cc revert lihongs patch which due to extra stuff
sender.h add -std=c++0x and deal with all kinds of type and namespace issues
simple_label.cc revert lihongs patch which due to extra stuff
simple_label.h changed label to include an initial offset, allowing residual prediction
sparse_dense.cc better version of Lihong's patch
sparse_dense.h better version of Lihong's patch
test.lua Omitted.
unique_sort.cc deleted debian-specific and tweaked n/skip generation so it made sens…
unique_sort.h deleted debian-specific and tweaked n/skip generation so it made sens…
v_array.h add -std=c++0x and deal with all kinds of type and namespace issues
vw.cc removed cg code
vw.h First sending core.

README.md

allreduce: a simple Lua wrapper around vowpal wabbit's allreduce implementation

This is a simple Lua interface to John Langford's allreduce implementation.

To use it, you simply neet to start a server on some arbitrary machine:

ssh mymachine
torch -lallreduce -e "allreduce.startserver()"

Once this daemon is running, you can run as many jobs as you like, on any machine, provided that you point to 'mymachine'.

From machine 1:

-- script 1:
allreduce.init('mymachine', 1, 2)  -- job 1/2
allreduce.average(somevector)

From machine 2:

-- script 2:
allreduce.init('mymachine', 2, 2)  -- job 2/2
allreduce.average(somevector)

After these calls, both scripts will have the same 'somevector'.

A test is provided in the source tree. After starting the server on 'localhost', you can run the test like this:

# process 1:
torch test.lua -id 1 -total 2

# process 2:
torch test.lua -id 2 -total 2

Install

Given a valid Torch7 install:

torch-pkg install allreduce

or, to retrieve the sources:

torch-pkg download allreduce
torch-pkg deploy allreduce

Copyrights

This is the vowpal wabbit fast online learning code. It is Copyright (c) 2009 Yahoo! Inc, and released for use under the BSD (revised) open source license.

Contributing authors are John Langford (Primary), Lihong Li, Alex Strehl, and Shubham Chopra, and Gordon Rios. This is the second VW release, and our intention is to create an open source project this time.

Checked into github with clone URL: git://github.com/JohnLangford/vowpal_wabbit.git

To get the code install git -- in a clean directory:

git clone git://github.com/JohnLangford/vowpal_wabbit.git

Gordon created a tag for the completely stock initial distribution '2.3' so to check out that original release and create a branch based on it:

git checkout 2.3 git checkout -b from-2.3

Or, in one command:

git checkout -b from-2.3 2.3

Swicegood, Travis. Pragmatic Version Control with Git. 2008. (p. 102)

Alternatively, the code can be downloaded directly from github:

http://github.com/gparker/vowpal_wabbit/downloads

Something went wrong with that request. Please try again.