Skip to content

A whole bunch of functions, filters, and other tools that make writing Cascading flows a joy

License

Notifications You must be signed in to change notification settings

strategist922/cascading-helpers

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

28 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

cascading-helpers

A whole bunch of functions, filters, and other tools that make writing Cascading flows a joy.

If you'd like to make your tests run faster, check out CascadingHelper. Example pseudocode:

// put this line in your test's setUp() method
CascadingHelper.setTestMode();
// build your assembly
...
// use CascadingHelper's getFlowConnector instead of instantiating one directly
// and your tests will now run much faster!
CascadingHelper.get().getFlowConnector().connect(...).complete();

If you'd like to make it easier to write your Flows and make them more readable, check out Pump:

Pump.prime()
  .each(new RegexFilter("^[0-9]+"), "line")
  .each(new RegexSplitter(new Fields("timestamp", "tag"), ","), "line")
  .coerce(long.class, "timestamp")
  .each(new BucketizeTimestamp(), "bucketized_timestamp")
  .discard(timestamp)
  .rename("bucketized_timestamp", "timestamp");
  .groupby("timestamp", "tag");
  .every(new Count(new Fields("count")));

More to come!

About

A whole bunch of functions, filters, and other tools that make writing Cascading flows a joy

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published