Skip to content

v0.9.5

Compare
Choose a tag to compare
@oalam oalam released this 26 Oct 13:37
· 2212 commits to master since this release
  • generify API from Event to Records
  • add docker container for demo
  • add topic auto-creation parameters
  • add Record validators
  • add processor chaining that works globally on an input/output topic and pipe in-memory contexts into sub-processors
  • better error handling for SplitText
  • testRunner API
  • migrate LogParser to LogProcessor Interface
  • reporting metrics to know where are exactly the processors on the topics
  • add an HDFSBurner Engine
  • yarn stability improvements
  • more spark parameters handling
  • driver failover through Zookeper offset checkpointing
  • add raw_content to event if regex matching failed in SplitText
  • integration testing with embedded Kafka/Spark
  • processor chaining