This project is a set of generic interfaces for GO Lang to interact with AWS using its native SDK. Golang has a powerful and robust framework that handles concurrency and parallelism well especially in distributed systems.
Dependencies:
- The intention of this repo is to have a standardized toolset that can be used for basic/robust interaction with AWS via parameters and configs to abstract out patterns that are commonly used. The methods available are idioms that can be interpreted by other languages such as Python or Java via the same patterns i.e. the bulder pattern.
-
aws: utility methods that interact with AWS from a data engineers point of view
- s3
- DynamoDB
- Amazon Managed Apache Cassandra Service (MCS)
- Cloudwatch
- STS (Secured Token Service)
- SES (Managed Email Service)
- AWS Secrets Manager (Config)
-
utilities: helper packages to compliment interactions within the sdk
- database: database interaction methods
- reader: a consumer of some sort where it takes an input object and reads concurrently via go channels
- scanner: a producer of some sort where it takes an input and writes concurrently via go routines
- utils: utility methods i.e. Logger that compliments repo
-
To use this as a standard library the import command is
go get -u https://github.com/polyglotDataNerd/poly-GO-utils