Overview

In Fire Insights, you can write your own processor in Apache Spark and plug them into Fire Insights. Once these processors are made available to Fire Insights via a jar file and field definitions captured in a JSON file, they appear within the Fire Insights Workflow Editor. Users can use these new processors like any other processor within Fire Insights. This repository contains a few sample processors to get you started.

Steps

• Checkout Code
• Directory Contents
• Build and Execute Examples
• Executing Workflow JSON With Spark Submit

Writing new Java/Scala Nodes

• Writing New Java/Scala Nodes
• Node Class Hierarchy
• Writing Machine Learning Nodes

Reference Docs

• Processor/Node JSON & Widgets
• JobContext and Workflow
• Workflow Parameters & Node Variables

Writing new PySpark Nodes

• Writing new PySpark Nodes

Workflow