Skip to content

EnableIoT and GearPump

Daniel Smith edited this page Sep 1, 2016 · 6 revisions

Apache Gearpump

Apache Gearpump is a lightweight, real-time, big data streaming engine using Akka. It can also be used as an underlying platform for other general distributed applications, like distributed cron jobs or distributed log collection. Apache Gearpump is inspired by recent advances in the Akka framework and a desire to improve on existing streaming frameworks. Apache Gearpump draws from a number of existing frameworks including MillWheel, Apache Storm, Spark Streaming, Apache Samza, Apache Tez, and Hadoop YARN, while leveraging Akka actors throughout its architecture.

See documentation on http://gearpump.apache.org

Apache Gearpump can be used standalone, but it is also a great fit with the Trusted Analytics Platform (TAP). It can be used for high-velocity data ingestion, stream data processing, online analytics, etc. At present, you can create a new Apache Gearpump Cluster on demand from the TAP Services Marketplace tab. (Masters and workers are deployed to YARN and Apache Gearpump Dashboard is run as a Cloud Foundry application.) An Apache Gearpump instance is available to all users of a given Organization.

The TAP console also includes an Apache Gearpump section in the Data Science tab. You can list service instances there. You can also deploy Apache Gearpump apps directly from the TAP console.

Continue reading to learn more:

Clone this wiki locally