This repository contains a set of example projects to continuously load data from an Amazon Managed Streaming for Apache Kafka (Amazon MSK) to Amazon Simple Storage Service (Amazon S3). We use Amazon Kinesis Data Firehose—an extract, transform, and load (ETL) service—to read data from a Kafka topic, transform the records, and write them to an Amazon S3 destination.
| Example | Architecture |
|---|---|
| msk-firehose-s3-stack |  |
| msk-serverless-firehose-s3-stack |  |
Enjoy!
- Amazon MSK Introduces Managed Data Delivery from Apache Kafka to Your Data Lake (2023-09-27)
- Amazon MSK integrations with Kinesis Data Firehose
- Amazon MSK Labs
See CONTRIBUTING for more information.
This library is licensed under the MIT-0 License. See the LICENSE file.