Skip to content
This repository has been archived by the owner on Dec 15, 2022. It is now read-only.

Flink
Compare
Choose a tag to compare
@mattcasters mattcasters released this 24 Feb 17:17
0.5.0
936c013

New & Improved:

  • Issue #32 : Flink support (Main Method)
  • Issue #28 : Improved BigQuery output
  • Issue #26 : Menu item to create kettle-beam-fat.jar / metastore.json
  • Issue #33 : Apache Beam 2.10.0
  • Issue #30 : Support for generic Kettle input steps
  • Issue #31 : Batching up rows for output steps like Neo4j Output.

Releasing the hundreds of MB in libraries for this release is not optimal for GitHub so you need to download the plugin elsewhere. Please download kettle-beam-0.5.0.zip and unzip it in the <PDI>/plugins/ folder.

Then patch your Kettle CE version 8.2 by unzipping pdi-engine-configuration-8.2.0.0-342.zip in and over your Kettle distribution root folder . Doing this adds "Beam" as a Run Configuration option besides "Pentaho" and "Spark". The source code for this new "Beam Run Configuration" can be found by getting branch 8.2.0.1 from pentaho-kettle in the engine-configuration plugin

For configuration and usage please see the README.md file in this project.

Assets 3