Setup Notes

To run zookeeper locally:
  Mac: https://blog.kompany.org/2013/02/23/setting-up-apache-zookeeper-on-os-x-in-five-minutes-or-less/
  Windows: https://support.lucidworks.com/hc/en-us/articles/203187153-Install-and-start-Zookeeper-server-on-Windows

To run RabbitMQ locally:
  Mac: brew install rabbitmq; brew services start rabbitmq
  Windows: https://www.rabbitmq.com/install-windows.html
           http://ramblingcookiemonster.github.io/RabbitMQ-Intro/

Spring Cloud Data Flow Primer

This is a presentation meant to educate users on on the basics of Spring Cloud Dataflow. The primary teaching mechanism is the powerpoint presentation that is included in this repository

Stream Shell DSL Demo

Ticktock

stream create ticktock --name ticktock --definition "time | log" --deploy

Transform stream with label

stream create --definition "http --server.port=9000 | step2: transform --expression=payload+'!' | log" --name mainstream --deploy

Filter Stream

stream create filterstream --definition "time | filter --expression=payload.contains('2') |log" --deploy

Twitter Stream and Taps

stream create tweets --definition "twitterstream --consumerKey=<yourkey> --consumerSecret=<yoursecret> --accessToken=<youraccess> --accessTokenSecret=<youraccesssecret> | log"

stream create tagcount --definition ":tweets.twitterstream > field-value-counter --fieldName=entities.hashtags.text --name=hashtags --store=redis" --deploy

stream create tweetlang  --definition ":tweets.twitterstream > field-value-counter --fieldName=lang --name=language --store=redis" --deploy

stream deploy tweets

Sample Projects

• sinkdemo - creates a sample sink that writes data to log

• sourcedemo - a source that sends "hello world" based periodically (defaults once every 5 seconds) to the next app in the stream

• sinkdemo - writes "hello world" to the console