Sample starter applications and code for use with the Spring XD project
Java JavaScript CSS HTML Scala Groovy Other
Failed to load latest commit information.
analytics-dashboard Upgrade to XD 1.3.1 Feb 24, 2016
analytics-pmml Update README.adoc Apr 11, 2014
batch-basic updated batch examples for Spring XD 1.1 Jan 20, 2015
batch-hashtag-count Adding MapReduce configuration files for cdh5, hdp22, phd21, phd30 Jun 4, 2015
batch-hive Updating "Note" entries Jun 16, 2015
batch-nested XD-2929: Added example of a nested job module in Spring XD Jun 8, 2015
batch-notifications XD-3046 fixed package names and upgrade to 1.2.0.BUILD-SNAPSHOT May 10, 2015
batch-pig Cleanup Aug 27, 2015
batch-simple upgraded to XD 1.1.1.RELEASE and extracted shared config (versions) Mar 26, 2015
batch-wordcount Updating "Note" entries Jun 16, 2015
groovy-script-sink upgraded to XD 1.1.1.RELEASE and extracted shared config (versions) Mar 26, 2015
hadoop-config Adding Hortonwoks HDP 2.3.2 link May 17, 2016
hdfs-partitioning Add hdfs sink partitioning sample May 30, 2014
kafka-message-bus updated version info Mar 26, 2015
kafka-source Updated Kafka examples for 1.1.0.RELEASE Feb 10, 2015
payload-conversion XD-3046 fixed package names and upgrade to 1.2.0.BUILD-SNAPSHOT May 10, 2015
payload-value-counter upgraded to XD 1.1.1.RELEASE and extracted shared config (versions) Mar 26, 2015
pivotal-hd-demo Update README.md Jul 18, 2014
reactor-moving-average upgraded to XD 1.1.1.RELEASE and extracted shared config (versions) Mar 26, 2015
reactor-tcp Update name of reactor module to reactor-ip and alter stream def Jul 14, 2014
reactor-top-tags upgraded to XD 1.1.1.RELEASE and extracted shared config (versions) Mar 26, 2015
redis-store-sink upgraded to XD 1.1.1.RELEASE and extracted shared config (versions) Mar 26, 2015
rss-feed-source Upgrade to XD 1.3.1 Feb 24, 2016
rxjava-moving-average Upgrade to XD 1.3.1 Feb 24, 2016
sample-modules-parent Upgrade to XD 1.3.1 Feb 24, 2016
samples-parent XD-2957 added serialization-benchmarks Jul 16, 2015
serialization-benchmarks XD-2957 added serialization-benchmarks Jul 16, 2015
si-dsl-module XD-3046 fixed package names and upgrade to 1.2.0.BUILD-SNAPSHOT May 10, 2015
simple-word-count Expanded the flow description Feb 28, 2015
smartgrid-prediction Update README Jun 5, 2015
spark-streaming-logger-java-sink Upgrade to XD 1.3.1 Feb 24, 2016
spark-streaming-logger-scala-sink Upgrade to XD 1.3.1 Feb 24, 2016
spark-streaming-wordcount-java-processor Upgrade to XD 1.3.1 Feb 24, 2016
spark-streaming-wordcount-scala-processor Upgrade to XD 1.3.1 Feb 24, 2016
storm-product-analytics-example upgraded to Spring XD 1.2.0.RELEASE Jun 16, 2015
syslog Add syslog example Feb 9, 2015
tweet-transformer-processor Upgrade to XD 1.3.1 Feb 24, 2016
working-with-sqoop Use uppercase for SNOWFALL table name Jul 6, 2015
.gitignore XD-2523 enabled gradle builds for modules Jan 29, 2015
LICENSE Initial commit Aug 11, 2013
README.md Add `smartgrid-prediction` demo Feb 25, 2015
pom.xml upgraded to XD 1.1.1.RELEASE and extracted shared config (versions) Mar 26, 2015

README.md

Spring XD Samples

This repository provides sample starter applications and code for use with the Spring XD project. The following samples are available:

analytics-dashboard

Standalone project which shows how you can use the D3 Javascript library to create visualizations for Spring XD counters.

analytics-pmml

Demonstrates the use of the analytics-pmml module by sending JSON data describing a Iris flower to an http source and using a PMML model to predict the species of Iris.

batch-basic

Shows how to deploy a simple Spring Batch process in Spring XD, without having to compile any code or install any jars.

batch-notifications

This sample will take an input file containing payment data, and import the data into a database using Spring XD's batch job support. During import, various notification events are triggered and printed to the console.

batch-hashtag-count

This sample will take an input file with Twitter JSON data and count the occurrences of hashtags.

batch-simple

This is the quintessential Hello World example for Spring XD. It consists of only one Spring Batch Tasklet which prints out Hello Spring XD!.

batch-wordcount

This is the Spring Batch word-count sample for Hadoop adapted for Spring XD. This sample will take an input file and count the occurrences of each word within that document.

groovy-script-sink

A custom module that illustrates how to bind variables defined as module options to a groovy script.

hdfs-partitioning

Demonstrates the hdfs sink and its partitioning features.

kafka-message-bus

This sample walks you through setting up Kafka as a message bus for Spring XD, also demonstrating partitining and failover.

kafka-source

This sample walks you through setting up a Kafka source in Spring XD, also demonstrating the use of multiple modules for ingestion efficiency.

payload-conversion

This sample project implements a custom processor and demonstrates the use of the Tuple data type.

pivotal-hd-demo

Demo using Spring XD with Pivotal HD.

reactor-moving-average

A custom module that uses Reactor's Stream API to perform stream analysis.

reactor-tcp

Demonstrates the use of Reactor's TCP input source

redis-store-sink

A simple custom sink module project implementing a Redis store, including integration tests.

rss-feed-source

A simple custom source module project implementing an RSS feed, including integration tests.

rxjava-moving-average

A custom module that uses RxJava's Observable API to perform stream analysis.

si-dsl-module

This sample demonstrates how to create a custom module project, including integration tests, and packaging the module as an uber-jar using maven (requires Spring XD 1.1.x). The project also demonstrates the use of the Spring Integration Java DSL

smartgrid-prediction

This sample showcases a fictional use of Spring XD in the context of smart electricity metering and production. It was inspired by the http://www.cse.iitb.ac.in/debs2014/?page_id=42[ACM Distributed Event Based Systems Grand Challenge 2014].

syslog

This sample demonstrates how to setup syslog ingestion from multiple hosts into HDFS.

tweet-transformer-processor

A simple custom processor module project, including integration tests. This one has no external dependencies other than the processor implementation and Spring configuration which is provided either as XML or @Configuration.