Incremental Script

Generic ETL Utility to pull data from any data source to Snowflake or any Target Source.

docs:

https://akhilpatlolla.github.io/Generic_ETL_Utility_AWS_GLUE/

Notes

1. You need you have all the respective JDBC connection drives in s3 and add those jar's to dependency path.
2. Add connection and other required permission in order to access JDBC connection
3. SSM parameter config object
   abcdefghijk = { "type":"mysql|redshift|oracle|sqlserver|postgresql",
   "user":"username",
   "multipleStatements":true,
   "password":"********",
   "port":5432|3306,
   "host":"p360-prod.mlprivate.net",
   "database":"program360" }
   
4. Command like parameter for the job
   --db1 = abcdefghijk