h2o = fast statistical, machine learning & math runtime for bigdata
Java Python R CSS CoffeeScript Shell Other
Latest commit be350f3 Sep 25, 2015 @jessica0xdata jessica0xdata Update index.html
Added `nthreads = -1` (per Ray)
Permalink
Failed to load latest commit information.
.settings Fixed 404 & 500 HTTP status Oct 4, 2013
R GBM Auto is not a valid distribution; Jun 11, 2015
bench flush out the caches with this C script Nov 1, 2013
ci Update release number. Oct 15, 2014
client Add tooltips and color-swatches to datum on visualizations Sep 3, 2014
docs Also roadmap update Mar 17, 2015
ec2 move cloudbuilder to h2o-ops private Oct 27, 2014
excel xValueslist cleared for blank template Jun 4, 2014
experiments/src/main Add support for visualization for DeepLearning neuron layers. Might n… May 7, 2014
h2o-cookbook Repackage gson to a private package name. Sep 15, 2014
h2o-docs-theme Add new documentation theme files. Apr 8, 2014
h2o-docs Fix formatting for Deep Learning Data Science May 8, 2015
h2o-parent Manual Maven magic. Nov 4, 2014
h2o-perf do not print exception when verifying h2o shutdown (exception means s… Oct 10, 2014
h2o-samples Automation example using Rest Calls Mar 13, 2015
h2o-scala Final revisions Dec 12, 2014
h2o-ux Top-level H2O project for UX-client. Oct 25, 2013
h2o-zookeeper Some .gitignore cleanup. Aug 7, 2014
hadoop Add more Log.POST messages. Feb 5, 2015
installer Cleaning up and bumping version of h2o (formerly, h2oWrapper) to 1.0.3 Oct 10, 2013
launcher add null check before ROCplot function call Feb 11, 2014
lib Added hdp2.2 driver. Feb 3, 2015
packaging Update index.html Sep 24, 2015
py Merge branch 'master' of github.com:h2oai/h2o Mar 7, 2015
qeng changing option from --with-html-out to --with-html. Differences from… Nov 3, 2014
scripts Newlines need to be ignored now by validate script May 14, 2015
selenium Move selenium-jar from github to under jenkins-home-dir Sep 24, 2013
smalldata Fixed ignored_columns handling in glm. Apr 13, 2015
spark Add spark README.txt to the zip file. Aug 11, 2014
src POJO: Store content of NAMES field in a separated class and May 30, 2015
tableau Update Tableau demo notebook for h2o.ddply instead of ddply. Dec 4, 2014
.classpath Moving toward fixing JSON serialization of longs (e.g., seed). Aug 18, 2014
.gitattributes Force gradlew to use LF endings. Aug 13, 2014
.gitignore adding .gradle to .gitignore Oct 30, 2014
.h2o_no_collect Basic Google Analytics Measurement Performance support. Notes about h… Nov 14, 2014
.project Adding back .project file. Jan 23, 2015
.pydevproject Initial commit Feb 6, 2013
.travis.yml added travis-ci support Apr 16, 2014
CHANGES.md Updated Recent Changes with updates for Nunes and Novikov Mar 21, 2015
CHANGES_By_Component.md CHANGES by component for easy summarization to customers Aug 16, 2014
LICENSE.txt Initial commit Feb 6, 2013
Makefile took out sed on nonexisting webpage Apr 13, 2015
README.md Add pointer to h2o-3 repo. Sep 4, 2015
build.sh PUB-219: Added working client-only HDFS support for hdp2.1. Aug 26, 2014
emacs_init.el Upgrade emacs Sep 2, 2014
get_s3_jar.sh get these runners going again for jenkins. Aug 29, 2014
manifest-test.txt Initial commit Feb 6, 2013
manifest.txt Job management + types Mar 10, 2013
pom.xml Manual Maven magic. Nov 4, 2014
prj.el Moving toward fixing JSON serialization of longs (e.g., seed). Aug 18, 2014
requirements.txt Add Python requirements file. Jan 13, 2014

README.md

Caution: H2O-3 is now the current H2O!

Please visit https://github.com/h2oai/h2o-3



H2O

H2O makes Hadoop do math! H2O scales statistics, machine learning and math over BigData. H2O is extensible and users can build blocks using simple math legos in the core. H2O keeps familiar interfaces like R, Excel & JSON so that BigData enthusiasts & experts can explore, munge, model and score datasets using a range of simple to advanced algorithms. Data collection is easy. Decision making is hard. H2O makes it fast and easy to derive insights from your data through faster and better predictive modeling. H2O has a vision of online scoring and modeling in a single platform.

Product Vision for first cut

H2O product, the Analytics Engine will scale Classification and Regression.

  • RandomForest, Generalized Linear Modeling (GLM), logistic regression, k-Means, available over R / REST / JSON-API
  • Basic Linear Algebra as building blocks for custom algorithms
  • High predictive power of the models
  • High speed and scale for modeling and scoring over BigData

Data Sources

  • We read and write from/to HDFS, S3, NoSQL, SQL
  • We ingest data in CSV format from local and distributed filesystems (nfs)
  • A JDBC driver for SQL and DataAdapters for NoSQL datasources is in the roadmap. (v2)

Console provides Adhoc Data Analytics at scale via R-like Parser on BigData

  • Able to pass and evaluate R-like expressions, slicing and filters make this the most powerful web calculator on BigData

Users

Primary users are Data Analysts looking to wield a powerful tool for Data Modeling in the Real-Time. Microsoft Excel, R, SAS wielding Data Analysts and Statisticians. Hadoop users with data in HDFS will have a first class citizen for doing Math in Hadoop ecosystem. Java and Math engineers can extend core functionality by using and extending legos in a simple java that reads like math. See package hex. Extensibility can also come from writing R expressions that capture your domain.

Design

We use the best execution framework for the algorithm at hand. For first cut parallel algorithms: Map Reduce over distributed fork/join framework brings fine grain parallelism to distributed algorithms. Our algorithms are cache oblivious and fit into the heterogeneous datacenter and laptops to bring best performance. Distributed Arraylets & Data Partitioning to preserve locality. Move code, not data, not people.

Extensions

One of our first powerful extension will be a small tool belt of stats and math legos for Fraud Detection. Dealing with Unbalanced Datasets is a key focus for this. Users will use JSON/REST-api via H2O.R through connects the Analytics Engine into R-IDE/RStudio.

Community

We will build & sustain a vibrant community with the focus of taking software engineering approaches to data science and empowering everyone interested in data to be able to hack data using math and algorithms. Join us on google groups h2ostream.

Team

SriSatish Ambati
Cliff Click
Tom Kraljevic
Earl Hathaway
Tomas Nykodym
Michal Malohlava
Kevin Normoyle
Irene Lang
Spencer Aiello
Anqi Fu
Nidhi Mehta
Arno Candel
Nikole Sanchez
Josephine Wang
Amy Wang
Max Schloemer
Ray Peck
Anand Avati
Sebastian Vidrio

Open Source

Jan Vitek
Mr.Jenkins
Petr Maj
Matt Fowles

Advisors

Scientific Advisory Council

Stephen Boyd
Rob Tibshirani
Trevor Hastie

Systems, Data, FileSystems and Hadoop

Doug Lea
Chris Pouliot
Dhruba Borthakur
Charles Zedlewski

Investors

Jishnu Bhattacharjee, Nexus Venture Partners
Anand Babu Periasamy
Anand Rajaraman
Dipchand Nishar