Skip to content
This repository

HTTPS clone URL

Subversion checkout URL

You can clone with HTTPS or Subversion.

Download ZIP

h2o = fast statistical, machine learning & math runtime for bigdata

PUB-168 allow subsetting by Strings

NB: May not work with h2o.exec() for now
latest commit 817aa5b51b
SpencerA SpencerA authored
.settings Fixed 404 & 500 HTTP status
R PUB-168 allow subsetting by Strings
bench flush out the caches with this C script
ci Bump master to 2.5.
client Patch up variable importance handling.
docs Added some architecture and developer documentation.
ec2 Cleanup in generated files.
excel xValueslist cleared for blank template
experiments Add support for visualization for DeepLearning neuron layers. Might n…
h2o-cookbook Added demos to cookbook
h2o-docs-theme Add new documentation theme files.
h2o-docs STEAM tutorial
h2o-parent h2o-parent README updated
h2o-perf report on the tests that fail and that also coincide with tests exist…
h2o-samples PUB-806: Add toy datasets for outlier dectection to LoadDatasets.java.
h2o-scala GBM call for Shalala API.
h2o-ux Top-level H2O project for UX-client.
hadoop Add -verbose:class.
installer Cleaning up and bumping version of h2o (formerly, h2oWrapper) to 1.0.3
launcher add null check before ROCplot function call
lib Merge remote-tracking branch 'origin/master' into MM_tachyon_pers
packaging Add test before detach and remove.packages.
py Merge branch 'master' of https://github.com/0xdata/h2o
scripts if parameter is ENUM don't scrape out.whole.ENUM (remove .)
selenium Move selenium-jar from github to under jenkins-home-dir
smalldata Dataset for testing strong rules for jira pub-831
src PUB-168 allow subsetting by Strings
.classpath Fixed missing tachyon library in the eclipse configuration file.
.gitattributes Initial commit
.gitignore Modify .gitignore to ignore /lib/resources/steam
.project Remove python from top level project.
.pydevproject Initial commit
.travis.yml added travis-ci support
CHANGES.md Added Kolmogorov release notes.
LICENSE.txt Initial commit
Makefile Added some architecture and developer documentation.
README.md Fix a few typos
build.sh Remove lib/javassist for clean.
emacs_init.el Hacks for emacs on Windoze8
get_s3_jar.sh -v latest will translate to latest
manifest-test.txt Initial commit
manifest.txt Job management + types
pom.xml Removed transient dependencies for tachyon.
prj.el Fix cbind ref counting
requirements.txt Add Python requirements file.
README.md

H2O

H2O makes Hadoop do math! H2O scales statistics, machine learning and math over BigData. H2O is extensible and users can build blocks using simple math legos in the core. H2O keeps familiar interfaces like R, Excel & JSON so that BigData enthusiasts & experts can explore, munge, model and score datasets using a range of simple to advanced algorithms. Data collection is easy. Decision making is hard. H2O makes it fast and easy to derive insights from your data through faster and better predictive modeling. H2O has a vision of online scoring and modeling in a single platform.

Product Vision for first cut

H2O product, the Analytics Engine will scale Classification and Regression.

  • RandomForest, Generalized Linear Modeling (GLM), logistic regression, k-Means, available over R / REST / JSON-API
  • Basic Linear Algebra as building blocks for custom algorithms
  • High predictive power of the models
  • High speed and scale for modeling and scoring over BigData

Data Sources

  • We read and write from/to HDFS, S3, NoSQL, SQL
  • We ingest data in CSV format from local and distributed filesystems (nfs)
  • A JDBC driver for SQL and DataAdapters for NoSQL datasources is in the roadmap. (v2)

Console provides Adhoc Data Analytics at scale via R-like Parser on BigData

  • Able to pass and evaluate R-like expressions, slicing and filters make this the most powerful web calculator on BigData

Users

Primary users are Data Analysts looking to wield a powerful tool for Data Modeling in the Real-Time. Microsoft Excel, R, SAS wielding Data Analysts and Statisticians. Hadoop users with data in HDFS will have a first class citizen for doing Math in Hadoop ecosystem. Java and Math engineers can extend core functionality by using and extending legos in a simple java that reads like math. See package hex. Extensibility can also come from writing R expressions that capture your domain.

Design

We use the best execution framework for the algorithm at hand. For first cut parallel algorithms: Map Reduce over distributed fork/join framework brings fine grain parallelism to distributed algorithms. Our algorithms are cache oblivious and fit into the heterogeneous datacenter and laptops to bring best performance. Distributed Arraylets & Data Partitioning to preserve locality. Move code, not data, not people.

Extensions

One of our first powerful extension will be a small tool belt of stats and math legos for Fraud Detection. Dealing with Unbalanced Datasets is a key focus for this. Users will use JSON/REST-api via H2O.R through connects the Analytics Engine into R-IDE/RStudio.

Community

We will build & sustain a vibrant community with the focus of taking software engineering approaches to data science and empowering everyone interested in data to be able to hack data using math and algorithms. Join us on google groups h2ostream.

Team

SriSatish Ambati
Cliff Click
Tom Kraljevic
Earl Hathaway
Tomas Nykodym
Michal Malohlava
Kevin Normoyle
Irene Lang
Spencer Aiello
Anqi Fu
Nidhi Mehta
Arno Candel
Nikole Sanchez
Josephine Wang
Amy Wang
Max Schloemer
Ray Peck
Anand Avati

Open Source

Jan Vitek
Mr.Jenkins
Petr Maj
Matt Fowles

Advisors

Scientific Advisory Council

Stephen Boyd
Rob Tibshirani
Trevor Hastie

Systems, Data, FileSystems and Hadoop

Doug Lea
Chris Pouliot
Dhruba Borthakur
Charles Zedlewski

Investors

Jishnu Bhattacharjee, Nexus Venture Partners
Anand Babu Periasamy
Anand Rajaraman
Dipchand Nishar
Something went wrong with that request. Please try again.