Skip to content

Fire examples with Nodes and Workflows for Writing a New Node in Sparkflows

Notifications You must be signed in to change notification settings

sparkflows/writing-new-node

Repository files navigation

Overview

In Fire Insights, you can write your own processor in Apache Spark and plug them into Fire Insights. Once these processors are made available to Fire Insights via a jar file and field definitions captured in a JSON file, they appear within the Fire Insights Workflow Editor.

Users can use these new processors like any other processor within Fire Insights. This repository contains a few sample processors to get you started.

Repository Structure

The layout of this Repository is defined here:

Steps for Building & Executing the Examples here

Writing new Processors in Java/Scala

Reference Docs

Writing new PySpark Nodes

Workflow

About

Fire examples with Nodes and Workflows for Writing a New Node in Sparkflows

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published