DynamoDB Partitioned S3

Purpose: Working example of using DynamoDB Streams, EventBridge Pipes and Kinesis Firehouse to build a partitioned S3 bucket that can be used for Glue Analytics

Getting Started

Deploying

First off, install Node.js

# install AWS CDK
npm install -g aws-cdk
# clone the repository
cd dynamodb-partioned-s3
npm install

Once dependencies have been installed, you are ready to run CDK

cdk deploy

Destroying

Simply run:

cdk destroy

Implementation

For a further and in-depth review of how to use this repository and what it supports, head on over the Blog Article

Architecture