Technologies

• Golang
• Terraform
• Localstack
• AWS S3
• AWS Glue
• AWS Athena

Todo:

• Create cronjob to convert Json into Parquet
• Change Glue + Athena to fetch new Parquet data
• Setup Terraform for local development

Run GitHub pipelines locally with Act:

act -W .github/workflows/ci.yml \
-P ubuntu-latest=catthehacker/ubuntu:act-latest \
--secret-file .env

Deploy to K8s:

docker build -t go_app .

kind load docker-image go_app:latest

kubectl apply -f .