This repository hosts custom Greengrass components
-
Updated
Jan 16, 2024 - Python
This repository hosts custom Greengrass components
The purpose of this repository is to apply a data ingestion with Amazon Kinesis Firehose saving that data to S3 using the boto3. After that I use AWS Glue to catalog and Athena to query the data.
IaC to simulate a microsservice hosted in AWS based on messages
A project using AWS to combine and transform streaming data for analytics.
Keywords: Python, AWS Kinesis, AWS Firehose, AWS Lambda, Snowflake, AWS S3, AWS Athena
Serverless big data streaming application using a fan-out architecture with Lambda and SQS to fetch data from Reddit forums, stream to Kinesis Firehose and store in an S3 data lake.
The simple solution that resolves problem adding new partitions created by Kinesis Firehose into Amazon Athena
An end-to-end AWS data engineering pipeline that orchestrates data ingestion, processing, and storage using Kinesis, S3, Redshift, Lambda, DynamoDB
Backup your twitter account on a daily basis
AWS based tool to analyse the spread of misinformation on Twitter.
This repository for researching and building a pipeline where a client sends data to AWS-iotcore where Kinesis Firehose will buffer and feed the data to a Lambda function.
Exciting AWS project that combines a streamlined pipeline for near real-time updates. The architecture is powered by essential AWS services like IAM, VPC, RDS, DMS, Kinesis, S3, and Redshift
A streaming data pipeline leveraging managed services from AWS & the serverless architecture
Streaming data analysis using AWS tools such as Cloud9 to generate events in the cloud, using boto3 to send records to Kinesis Data Firehose to connect to the S3 bucket destination, saving files in .parquet format. With the help of Glue, a data catalog will be created to enable real-time querying of all records with Athena.
The Project aims to establish a robust data pipeline for tracking and analyzing sales performance using various AWS services. The process involves creating a DynamoDB database, implementing Change Data Capture (CDC), utilizing Kinesis streams, and finally, storing and querying the data in Amazon Athena.
This project shows how to implement a simple SaaS metering system on AWS
AWS Kinesis Data Firehose logging handler for Python
A simple adapter that takes records from a DynamoDB stream and sends them to a Kinesis Firehose for processing.
Add a description, image, and links to the kinesis-firehose topic page so that developers can more easily learn about it.
To associate your repository with the kinesis-firehose topic, visit your repo's landing page and select "manage topics."