Skip to content

Release R97 Knossos (2017-12-18)

Compare
Choose a tag to compare
@BenFradet BenFradet released this 18 Dec 16:06
· 1143 commits to master since this release

Four new webhooks: Olark, StatusGator, Unbounce, Mailgun

EmrEtlRunner

  • Add ability to skip RDB Loader consistency check (#3529)
  • Bump to 0.30.0 (#3526)
  • Uncompress gzipped raw files when copying to HDFS (#3525)
  • Update spark_enrich version in config.yml.sample to 1.11.0 (#3002)

Scala Common Enrich

  • Add Adapter to pre-process Olark events (#1014)
  • Add adapter to pre-process Mailgun webhooks (#2734)
  • Add adapter to pre-process Statusgator webhooks (#2169)
  • Add adapter to pre-process Unbounce webhooks (#2615)
  • Add function to camelCase all JSON fields in Adaptor (#3538)
  • Bump user-agent-utils to 1.20 (#2930)
  • Default port to 443 if scheme is https (#3483)
  • Make enrichments.ExtractEventTypeSpec timezone-safe (#3481)
  • Remove toSecond parameter in Adapter (#3534)
  • Tolerate content type for GET requests sent to Clojure Collector (#2743)

Spark Enrich

  • Bump to 1.11.0 (#3533)
  • Add test for Mailgun Adapter (#2763)
  • Add test for Olark Adapter (#2792)
  • Add test for StatusGator Adapter (#2722)
  • Add test for Unbounce Adapter (#2745)
  • Fix tests that fail when running on an alternative iglu service (#3503)
  • Fix tests that fail with error when running on a platform that doesn't have native-lzo (#3508)
  • Improve error message in test to show index line (#3494)

Common

  • Reenable publishLocal in travis for spark enrich tests to pass (#3516)
  • Rename AWS deployment credentials in .travis.yml (close #3115)