Detailed walkthrough
- End to end data lake experience
- Purpose built DB getting started
- RDS getting started
- Migrating from MySQL to RDS MySQL using Percona XtraBackup
- Redshift getting started
- Connect to Glue dev endpoint from VS Code
- Using Step Functions to orchestrate a transient EMR cluster
Code to resolve some challenging problems
- Connecting Tableau Desktop to Amazon Athena
- Using AWS Wrangler in Glue where Internet is not allowed
- Using R with Amazon Redshift
-
Regression methods - predict housing prices
- Data preprocessing: scikit-learn pipeline, custom transformer
- Linear models: Ridge, Lasso, ElasticNet
- Ensembling: Random forest, GBRT
-
- Dimensionality reduction and its effect on classification
-
- MLP design (# of neurons and hidden layers) with a good model performance and short training time
-
CNN - Dogs vs. Cats (25000 images)
- Importance of image augmentation
- Transfer learning from Xception
-
- Pretrained sentence encoder - nnlm-en-dim50
- Pretrained word vectors - GloVe.6B, GloVe.Twitter