- Install requirements libraries using this command
pip install -r requirements.txt
- In Airflow you need to add connection for
gcp_conn_id
andmysql_conn_id
. - in etl.py, filled
BUCKET_NAME
,SQL_QUERY
,FILENAME
,gcp_conn_id
,mysql_conn_id
,schema
,destination_dataset_table
- Then you can just run the airflow and the dags
Then finally, you have moved your data from MySQL into BigQuery.