This project provides an example of how to use Amazon S3 Event Notifications with Amazon EventBridge with the lambda written in Go.
This project is deployed using cloudformation, with a stack managing the S3 data storage, and a stack holding the EventBridge rule and lambda which is triggered each time an s3 object is created. These stacks are decoupled which is a nice change from the original s3 events options and avoids complex cross service IAM policies.
If the file is a parquet format file the lambda receiving the event will log some information using Apache Arrow.
I have also included an example of using oapi-codegen to generate Go types for the s3 Object Created
Amazon EventBridge OpenAPI 3 Schema provided by AWS.
This application is released under Apache 2.0 license and is copyright Mark Wolfe.