Projects of design and Orchestration of Big data Projects Using Google Cloud
Below is a collection of key files in this repository:
| File Name | Description | Providers |
|---|---|---|
| VertexAI_notebook.md | Using Vertex AI | GCP |
| bigQuery_lab_challenge.md | Analysing data using sql in bigquery | GCP |
| bigbquery_sql.md | using standard sql in bigquery | GCP |
| data_tools_script.md | scrips using bash to analyse data | GCP |
| dataflow_challenge_lab.md | Using streming tool of dataflow to build a data pipeline | GCP |
| dataprep_challenge.md | Using UI of data prep to analyse data and transfrom the data | GCP |
| join_partition_using_Bigquery.md | how to do sharding in bigquery | GCP |