Telegraf Output Plugin for Amazon Kinesis Data Firehose

A collection of lambda functions to collect data from Cloudwatch, Kinesis, VPC Flow logs, S3, security-hub and AWS Inspector

Typical use cases of opensearch serverelss: search, time-series, kinesis firehose integration, securing with VPC

Receives data from firehose and puts it to ElasticSearch

This web analytics demo shows how to collect web logs with API Gateway and store them into S3 through Amazon Kinesis. Then this project shows how to analyze web logs with Amazon Athena.

High-Performance AWS Kinesis Client for Go

A streaming data pipeline leveraging managed services from AWS & the serverless architecture

Dynamic Terraform module, which creates a Kinesis Firehose Stream and others resources like Cloudwatch, IAM Roles and Security Groups that integrate with Kinesis Firehose. Supports all destinations and all Kinesis Firehose Features.

Amazon Kinesis output plugin for Fluentd

An end-to-end AWS data engineering pipeline that orchestrates data ingestion, processing, and storage using Kinesis, S3, Redshift, Lambda, DynamoDB

This project shows how to implement a simple SaaS metering system on AWS

Fluent Plugin for Amazon Kinesis

The Project aims to establish a robust data pipeline for tracking and analyzing sales performance using various AWS services. The process involves creating a DynamoDB database, implementing Change Data Capture (CDC), utilizing Kinesis streams, and finally, storing and querying the data in Amazon Athena.

Embracing Modern Data Solutions: Transitioning from Apache Flink to Redis and AWS Lambda with SQS and Kinesis

Using DynamoDb Stream to capture item-level changes in the DynamoDb table, then use kinesis data stream and kinesis firehose to save the changes into a s3 bucket.

This repository hosts custom Greengrass components

AWS Kinesis Analytics gather metrics from various computers (cpu, memory), perform aggregation on Kinesis stream data using Kinesis Analytics (with flink) and store the stream data into AWS S3 bucket which is used by Amazon Athena for running various Analytics queries and rending charts using Grafana.

The purpose of this sample is to show how to create a serverless and centralized architecture to ingest, store and query logs utilizing Amazon Kinesis Data Firehose, Amazon S3 and Amazon Athena.

Serverless Data pipeline with Api Gateway, AWS lambda, Amazon Kinesis, S3 and Snoflake

This repository contains an End to End Real time 🕰️ Machine Learning Pipeline to predict star ⭐️ rating of product reviews. This project uses AWS Sagemaker, Kinesis, Lambda, S3, Redshift, Athena, and Step functions. Deployment of multiple models for AB testing and Bandit testing is also included.