Jupyter Notebook HTML Python JavaScript CSS Scala Other
Permalink
Failed to load latest commit information.
apachespark.ml added openblas, updated tensorflow 1.0, cleaned up chaosmonkey Feb 18, 2017
api.ml added new sub-projects Jan 27, 2017
cassandra.ml updated labels Jan 19, 2017
chaosmonkey.ml added chaos monkey Feb 11, 2017
clustered.ml added openblas, updated tensorflow 1.0, cleaned up chaosmonkey Feb 18, 2017
dashboard.ml prometheus hystrix metrics publisher Feb 8, 2017
databricks.ml added new sub-projects Jan 27, 2017
education.ml added openblas, updated tensorflow 1.0, cleaned up chaosmonkey Feb 18, 2017
elasticsearch.ml updated labels Jan 19, 2017
explore.ml added new sub-projects Jan 27, 2017
gpu.ml added openblas, updated tensorflow 1.0, cleaned up chaosmonkey Feb 18, 2017
hdfs.ml Update Dockerfile Feb 17, 2017
jupyterhub.ml added openblas, updated tensorflow 1.0, cleaned up chaosmonkey Feb 18, 2017
keyvalue.ml udpated redis to latest 3.2.7 Feb 11, 2017
kibana.ml updated labels Jan 19, 2017
kubernetes.ml updated packages for google-cloud install Feb 7, 2017
loadtest.ml typo Feb 17, 2017
metastore.ml updated labels Jan 19, 2017
metrics.ml expose metrics in grafana thru prometheus Feb 14, 2017
online.ml Rename README.md to README.md.old Dec 21, 2016
oreilly.ml added new sub-projects Jan 27, 2017
package.ml added openblas, updated tensorflow 1.0, cleaned up chaosmonkey Feb 18, 2017
prediction.ml added openblas, updated tensorflow 1.0, cleaned up chaosmonkey Feb 18, 2017
presto.ml updated labels Jan 19, 2017
scheduler.ml added openblas, updated tensorflow 1.0, cleaned up chaosmonkey Feb 18, 2017
scripts added openblas, updated tensorflow 1.0, cleaned up chaosmonkey Feb 18, 2017
sql.ml updated labels Jan 19, 2017
stream.ml Rename README.md to README.md.old Dec 21, 2016
web.ml updated labels Jan 19, 2017
zeppelin.ml added openblas, updated tensorflow 1.0, cleaned up chaosmonkey Feb 18, 2017
zookeeper.ml updated labels Jan 19, 2017
.gitignore python support, refactored java support Feb 15, 2017
LICENSE replaced with next gen PipelineIO Dec 6, 2016
README.md Update README.md Feb 8, 2017

README.md

PipelineIO

Built with Love and Scale by ex-Netflix, Databricks, and Tensorflow Engineers

Tensorflow Databricks Netflix

Videos

Reference Architecture

Reference Architecture

100% Open Source

Jupyter ZeppelinZeppelin Spark Tensorflow

Completely Kubernetes and Docker Based

PipelineIO Kubernetes Kubernetes Docker

PMML + Native C++/Java Code Generation for Optimized CPU/GPU Performance

Generate and Optimize Spark ML Model Nvidia GPU Intel CPU

Deploy directly from Jupyter Notebook to Hybrid-Cloud Microservices

Deploy Spark ML Model to Production

NetflixOSS-based Microservices for High Scalability and Availability

NetflixOSS-based Microservices

Continuous Train/Deploy Spark ML and Tensorflow AI Pipelines to Production

Kafka Kinesis KINESIS

Environment Setup

Pipeline on Mini (Local Laptop)

  • Small Kubernetes cluster for your laptop

Kubernetes Docker

Pipeline on AWS

  • Kubernetes cluster on any cloud provider or on-premise

AWS

Pipeline on Google

  • Kubernetes cluster across many cloud providers and/or on-premise

Google Cloud Platform

PipelineIO on Azure

Azure

Global 24x7 Support for Everyone!

Additional Resources

Training Repo and Workshop Schedule

Workshop Architecture

Workshop Tools

Global Advanced Spark and Tensorflow Meetup

Meetup

Slideshare Slides

Slideshare

YouTube Videos

YouTube

Docker Images

Docker