DynamoDB_to_Athena

AWS has Athena service which can query structured data from S3. The DynamoDB is managed NoSQL database. So we have to convert Unstructured data to Structured data. The code written in python & performs this objective.

Steps to use script

git clone https://github.com/niravshah2705/DynamoDB_to_Athena
cd DynamoDB_to_Athena
./setup.sh
python awsglue.py <table Name>

Design Diagram

Future Steps

• Would provide cloudformation script along with setup.sh
• Would prepare Terraform script
• More customization with external parameterized command
• Increase security by further reduce access granularity

Reference Document

• https://aws.amazon.com/blogs/database/simplify-amazon-dynamodb-data-extraction-and-analysis-by-using-aws-glue-and-amazon-athena/
• https://niravshah2705-software-engineering.blogspot.com/2018/12/dynamodb-to-s3-athena.html