Friendly CLI for Amazon Kinesis Data Streams

Setup an ETL from Twitter API to S3

Iot,Big Data Analytics using Apache-kafka,spark and other aws services

Describes the concepts of lambda architecture and the actual deployment process with an example of building a serverless business intelligence systems using Amazon Kinesis, S3, Athena, OpenSearch Service, and QuickSight.

Example project for consuming AWS Kinesis streamming and save data on Amazon Redshift using Apache Spark

Sample scripts for Twitter data processing and storage on AWS

you run a script to mimic multiple sensors publishing messages on an IoT MQTT topic, with one message published every second. The events get sent to AWS IoT, where an IoT rule is configured. The IoT rule captures all messages and sends them to Firehose. From there, Firehose writes the messages in batches to objects stored in S3. In S3, you set u…

automatic image tagger and image tag analysis

This sample application demonstrates Amazon SNS with AWS X-Ray active tracing

Shipping AWS RDS logs from s3 into a kinesis stream

Utility code for AWS Services. Sample use case could be querying data from KDS. This project is open to receive contribution.

AWS Kensis Destionation - Http Endpoint Demo

Big Data Lab | Stream Delivery AWS Kinesis Firehose

Recovers Kinesis Firehose source records from S3, replaying them into the stream

A streaming data pipeline leveraging managed services from AWS & the serverless architecture

Demo of running AWS Lambda and AWS Kineses locally using Localstack

Pinterest's experiment analytics data pipeline which runs thousands of experiments per day and crunches billions of datapoints to provide valuable insights to improve the product.

AWS framework to stream, classify, index and store data

Recover AWS Kinesis Firehose errors by running the COPY command to each of the manifests file in the S3 errors folders