Skip to content


Subversion checkout URL

You can clone with
Download ZIP
Kettle plugin that provides support for interacting within many "big data" projects including Hadoop, Hive, HBase, Cassandra, MongoDB, and others.
Java PigLatin

Merge pull request #407 from pentaho/future-develop

Auto-Merge refreshing development branch
latest commit a9531006e0
@buildguy buildguy authored
Failed to load latest commit information.
build-res [ENGOPS-1237] Update subfloor javac and javadoc jdk
package-res [ENGOPS-512] pack oss license file via ivy resolve
res [PDI-13811] PDI Step/Entry Icon Revisions (based on logo usage)
samples/jobs/hadoop [PDI-12749][TEST] - PMR: Bad Results in Group-By if an entire key is …
src [PDI-13905] Browse button not working on Oozie Job Executor
test-res [PDI-13700] - S3 File Output Fails when writing to large buckets
test-src [PDI-13700] - S3 File Output Fails when writing to large buckets
.classpath Fixed plugin project dependencies to mapred classes. Shims now publis…
.gitignore Now ignoring test artifacts (pdi-*)
.project BAD-38: Moved shims into their own project (pentaho-hadoop-shims)
LICENSE.txt [BAD-8] Updated license to Apache License, Version 2.0.
README.markdown Added project README Merge branch 'future-develop'
build.xml [BACKLOG-2052] big-data-plugin assembly includes metastore jar
ivy.xml [BAD-245] - Compile MapR 4.1 Shim
ivysettings.xml [ENGOPS-911] Subfloor update for jacoco + sonar tooling
package-ivy.xml [PDI-4601] Fixing artifacts
package-samples-ivy.xml [build] updated package-samples-ivy.xml to correctly add -samples to …
pentaho-big-data-plugin.iml [PDI-7843] - "Basic Options" mode functional. more extraction of re-u…


Pentaho Big Data Plugin

The Pentaho Big Data Plugin Project provides support for an ever-expanding Big Data community within the Pentaho ecosystem. It is a plugin for the Pentaho Kettle engine which can be used within Pentaho Data Integration (Kettle), Pentaho Reporting, and the Pentaho BI Platform.


The Pentaho Big Data Plugin is built with Apache Ant and uses Apache Ivy for dependency management. All you'll need to get started is Ant 1.7.0 or newer to build the project. The build scripts will download Ivy if you do not already have it installed.

$ git clone git://
$ cd big-data-plugin
$ ant

This will produce a plugin archive in dist/pentaho-big-data-plugin-${project.revision}.tar.gz (and .zip). This archive can then be extracted into your Pentaho Data Integration plugin directory.

Further Reading

Additional documentation is available on the Community wiki: Big Data Plugin for Java Developers


Licensed under the Apache License, Version 2.0. See LICENSE.txt for more information.

Something went wrong with that request. Please try again.