Deduplication, stability and performance improvements.

New features

  • Add in-batch natural deduplication (#48)
  • Add cross-batch natural deduplication (#33)
  • Add table migration command (#68)
  • Add optional host property to configuration (#59)
  • Add ON_ERROR setting (#43)

Internal

  • Add a link to wiki to README (#65)
  • Update JDBC useragent to self-identify Snowplow (#52)
  • Update README markdown in according with CommonMark (#46)

Stability improvements

  • Use s3committer in Transformer (#67)
  • Recover DynamoDB on expired token exception (#51)
  • Fix silent skip for folder outside of a stage (#62)
  • Remove VARCHAR-precision when loading from temporary table (#54)
  • Truncate columns on loading (#55)
  • Widen geo_region to 3 characters (#58)
  • Setup of warehouse should set Auto Suspend to 5 mins and Auto Resume to true (#15)
  • Widen sensitive columns in atomic.events to support pseudonymization (#56)
Assets 2