Machine Learning Engineer Study Guide

After years of trying to organize my learning in notebooks, flashcards and my increasingly porous brain, this repo is an attempt to build something lasting. Pull requests welcome.

Programming

Section	Sources	Code Examples
Object Oriented Programming	- [x] SOLID Principals	TBD
Design Documents	[x] Eugene Yan: Writing ML Design Docs	TBD

Python

Section	Sources	Code Examples
OOP In Python	- [x] OOP In Python (Real Python)	TBD
Python Testing With PyTest	- [x] Pytest Book (Brian Okken)	TBD

C++

| C++ Standard Library | [*] Hacking CPP | TBD |

MLOps

Section	Sources	Code Examples
Defining MLOps	[]	TBD
Training / Testing Skew		TBD
Feature Stores	- [x] Feathr (LinkedIn). MLOps.community podcast. 9/2/22 - [x] AWS Sagemaker-Feature Store Introduction - [x] Eugene Yan: Feature Stores - [x] Netflix - Distributed Time Travel - [] Feast Feature Store	TBD
Experiment Tracking	- []	TBD
Data Version Control	- [] DVC Docs	TBD

Faster ML

Section	Sources	Code Examples
Extending Python With C++	TBD	TBD
Hardware For ML	[x] Designing Machine Learning Systems	TBD
GPU Acceleration with C++ (CUDA)	TBD	TBD
Pytorch AMP	TBD	TBD

Scaling ML

Section	Sources	Code Examples
Scaling RecSys	FB Recsys scaling paper	TBD
Kubernetes	[]	TBD

Systems Architecture

Section	Sources	Code Examples
Key Value Stores	ByteByteGo	TBD
System Design Patterns	TBD	TBD
Stream Ingestion	TBD	TBD

ML Techniques

Section	Sources	Code Examples
Ensembling	Designing Machine Learning Systems	TBD
Feature Engineering	TBD	TBD
Feature Selection	TBD	TBD
Neural Networks	Deep Learning With Python	TBD
Gradient Boosting Trees	TBD	TBD

Recommender Systems

Section	Sources	Code Examples
Popularity Bias	TBD	TBD

Natural Language Processing

Section	Sources	Code Examples
Transformers	TBD	TBD

Computer Vision

Section	Sources	Code Examples
Transformers	TBD	TBD

Reinforcement Learning

Section	Sources	Code Examples
Contraint Satisfaction in RL	TBD	TBD

Optimization

Section	Sources	Code Examples
Transformers	TBD	TBD

Cloud

Section	Sources	Code Examples
AWS Cloud Development Toolkit (CDK)	TBD	TBD

Resources

Future Resource List