Name		Name	Last commit message	Last commit date
parent directory ..
README.md		README.md
etl_data_to_gcs.py		etl_data_to_gcs.py
etl_gcs_to_bq.py		etl_gcs_to_bq.py

README.md

Prefect Workflow Orchestration

A GCS Bucket must be available in GCS to run this code.

Then create prefect block with the following configuration:

Name of the Bucket: your GCS Bucket
Add GCS credentials of the service account of your GCS Bucket

To upload the data to the GCS Bucket and send them to BigQuery follow the net steps:

Start Prefect Server:
```
prefect server start
```
Upload the files to the GCS Bucket:
```
python .\etl_data_to_gcs.py
```
Send the data to BigQuery:
```
 python .\etl_gcs_to_bq.py
```