AWSETL

End to End Data Engineering with AWS

Step 1

Create EC2 instance

Step 2

Run the below commands to install dependencies: sudo apt update sudo apt install python3-pip sudo apt install python3.10-venv python3 -m venv endtoendaws_venv source endtoendaws_venv/bin/activate pip install --upgrade awscli sudo pip install apache-airflow airflow standalone pip install apache-airflow-providers-amazon