python-on-aws-databases

AWS database and S3 data transfers moved by python: pep-8 examples

This is an ongoing project aimed at showcasing connectivity and transfer of data to several AWS database types. All of the files are python based, utilizing fragments from previous data pipeline projects. These include PostgreSQL, MySQL, MariaDB, Aurora, Athena, DynamoDB, Redshift, SQL Server and Oracle. The aim of the project is to create methods which are all bucket triggered. This will re-purpose the data and upload each data cut to each of the 9 different types of database. MemoryDB and Neptune are next on the list of additions.

Name		Name	Last commit message	Last commit date
Latest commit History 73 Commits
.gitignore		.gitignore
F-00-cur-importer.py		F-00-cur-importer.py
README.md		README.md
RED-LAYER.md		RED-LAYER.md
athena-execution-stats.py		athena-execution-stats.py
df.parquet.gzip		df.parquet.gzip
df.parquet.snappy		df.parquet.snappy
parquet.gzip		parquet.gzip
py-awswrangler-athena-to-df.py		py-awswrangler-athena-to-df.py
py-csv-to-postgres.py		py-csv-to-postgres.py
py-odbc-to-sql-server.py		py-odbc-to-sql-server.py
py-redshift-data-api-lambda-parquet.py		py-redshift-data-api-lambda-parquet.py
py-redshift-data-api.py		py-redshift-data-api.py
py-swap-db-pw-for-secrets-mgr.py		py-swap-db-pw-for-secrets-mgr.py
py-to-athena.py		py-to-athena.py
py-to-aurora.py		py-to-aurora.py
py-to-dynamodb.py		py-to-dynamodb.py
py-to-mariadb.py		py-to-mariadb.py
py-to-mysql.py		py-to-mysql.py
py-to-oracle.py		py-to-oracle.py
py-to-postgres-by-cursor.py		py-to-postgres-by-cursor.py
py-to-postgres.py		py-to-postgres.py
py-to-rds-using-glue.py		py-to-rds-using-glue.py
py-to-s3.py		py-to-s3.py
py-to-sftp-paramiko.py		py-to-sftp-paramiko.py
py-to-sql-server.py		py-to-sql-server.py
py-via-psycopg2.py		py-via-psycopg2.py
s3_order_modified_sorted.py		s3_order_modified_sorted.py

python3boto3/python-on-aws-databases

Folders and files

Latest commit

History

Repository files navigation

python-on-aws-databases

About

Topics

Resources

Stars

Watchers

Forks

Languages