Kylin OLAP

Overview

Extreme OLAP Engine for Big Data

An open source distributed Analytical Engine from eBay to provide SQL interface and multi-dimensional analysis (OLAP) on Hadoop to support TB to PB size analysis.

Getting Started

Prerequisites

Hadoop

• Hadoop: 2.2.0.2.0.6.0-61 or above
• Hive: 0.12.0.2.0.6.0-61 or above
• HBase: 0.96.0.2.0.6.0-61-hadoop2

Tested with Hortornworks distribution (HDP2.1.3), not tested with others yet.

Kylin Server

• Command hadoop, hive, hbase is workable on your hadoop cluster
• JDK Runtime: JDK7 (OpenJDK or Oracle JDK)
• Maven
• Git
• Tomcat
• Mysql

Before Install

• Mysql: mysql is running and user "root@localhost" without password is ready.
• For the quick tutorial, we assume that your hadoop has priviledges disabled which means any user could run hadoop and hive command
• CATALINA_HOME is set

Building Kylin

Git Clone

export KYLIN_REPO=Your Path #$KYLIN_REPO is your dir to handle kylin code base
mkdir -p $KYLIN_REPO
cd $KYLIN_REPO
git clone git@github.com:KylinOLAP/Kylin.git

Compile

To compile Kylin from source code, clone from this repository and run:

mvn clean compile

Kylin will run as web server for user to interactive with it, to generate deployment package (war file) for host on J2EE application server:

Package

mvn clean package

Kylin has a comprehensive set of unit tests that can take long time to run especially for cube generation. You can disable the tests when building:

mvn clean package -DskipTests

Run Kylin

To run Kylin, deploy geneated war file into J2EE application server like Tomcat, and restart application server. then access from browser via following URL: [http://<localhost>:<port>/<application name>]

Resources

• Google Group: Kylin OLAP Group

• Developer Mail: kylin-olap@googlegroups.com