The Kinesis lambda consumer is designed to read raw binary data files from a Kinesis shard, parse them into numeric data, combine the data that comes from the same watch, convert the data to parquet, and write the data to an S3 file. This is illustrated below:
