Write records to Kinesis in a batch

[kazjote]

This fixes problem with Kinesis Tee performance. See #31.

Additionally specs are updated to work with awscala 0.5.9.

[BenFradet]

Thanks, I'll have a look tomorrow 👍

[kazjote]

Thanks!

[snowplowcla]

@kazjote has signed the Individual Contributor License Agreement. Thanks so much

[BenFradet]

Looks great 👍

[BenFradet]

Couldn't we have this parameter as a configuration?

[kazjote]

I have update PR and made this configurable.

[BenFradet]

Looks great 👍 , could you open a pr against iglu-central too adding the 1-1-0 schema?

[kazjote]

@BenFradet I can. However, I am not sure if it is really Iglu schema. According to https://github.com/snowplow/iglu/blob/master/README.md

Iglu is a machine-readable, open-source schema repository for [JSON Schema] json-schema

but avro schema is not json-schema (however somehow similar). As far as I can see, there are at least differences in types (for example: "record", "int", "number"). I am not sure if anybody can use it with any json-schema validator. For example, it fails with this one: https://www.jsonschemavalidator.net/

Let me know if you still want to have avro schema in Iglu Central. If you do, I will create a PR.

[BenFradet]

We have avro schemas in iglu central too like the one for 1-0-0: https://github.com/snowplow/iglu-central/tree/master/schemas/com.snowplowanalytics.kinesistee.config/Configuration/avro

[christoph-buente]

@BenFradet: Kacpers contributions should be covered by the LiveIntent corporate CLA.

[snowplowcla]

@kazjote has signed the Software Grant and Corporate Contributor License Agreement. Thanks so much

[christoph-buente]

@BenFradet Any chance to have this PR accepted and released?

[BenFradet]

hey @christoph-buente , we're not maintaining this project anymore. I'll ask for it to be archived.

[christoph-buente]

Interesting, what are the proposed ways to filter streams for example for missing data or spider/bot traffic?

…

________________________________ From: Ben Fradet <notifications@github.com> Sent: Thursday, June 20, 2019 8:14:41 AM To: snowplow/kinesis-tee Cc: Christoph Bünte; Mention Subject: Re: [snowplow/kinesis-tee] Write records to Kinesis in a batch (#32) hey @christoph-buente<https://github.com/christoph-buente> , we're not maintaining this project anymore. I'll ask for it to be archived. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub<#32?email_source=notifications&email_token=AAAJBBTBUG5IOUMCD2XYGNLP3MN5DA5CNFSM4D7X4THKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODYEMGFQ#issuecomment-503890710>, or mute the thread<https://github.com/notifications/unsubscribe-auth/AAAJBBTTGUMFKK5RFZVNPHTP3MN5DANCNFSM4D7X4THA>.