Continuing with my case study on reading a big data file, this is the fifth part of my trilogy :-) on how I got on reading a big'ish file with C, Python, spark-python and spark-scala, AWS Elastic Map reduce and AWS Athena.

Personal take on GraphDB + AML with AWS Neptune + Glue + Lambda.

AWS has Athena service which can query structured data from S3. The DynamoDB is managed NoSQL database. So we have to convert Unstructured data to Structured data. The code written in python & performs this objective.

AWS Glue - Incremental Pull Script

AWS Glue tutorial for data developers.

Scaling sentiment analysis with AWS Glue and Amazon Comprehend.

Resources for AWS Almaty Meetup: Building scalable Data Lake with AWS

This is a project which demonstrates creation of a data pipeline by scraping data using twitter API and creating a data delivery stream using Kinesis Firehose for ingesting data to Amazon S3.

Através da API aws coleto e analiso dados para garantir um bom funcionamento dos ETL´S

Example of AWS Glue Jobs and workflow deployment with terraform in monorepo style. Code here supports the miniseries of articles about AWS Glue and python.

ETL Redshift-based workflow automated with AWS Step Funtions.

Serverless streaming ETL in with glue job & querying with Athena

Learn how to use Kinesis Firehose, AWS Glue, S3, and Amazon Athena by streaming and analyzing reddit comments in realtime. 100-200 level tutorial.

FHIR to OMOP using PySpark on AWS Glue

Build modern workflows with AWS MWAA, AWS Step Functions, AWS Glue, and AWS EMR

This module is used to configure AWS resources to work with the Shepherd Protective DNS records.

Run AWS Glue Crawler and check the status by AWS Step functions.

This repository has a collection of utilities for Glue Crawlers. These utilities come in the form of AWS CloudFormation templates or AWS CDK applications.

Used AWS Glue to perform ETL operations and load resultant data to AWS Redshift. In the second phase used AWS CloudWatch rules and LAMBDA to automatically run GLUE Jobs