A python script for upload Online File to Google Cloud Storage (GCS) built on Docker
-
Updated
Dec 17, 2022 - Python
Google Cloud Platform, offered by Google, is a suite of cloud computing services. It provides Infrastructure as a Service, Platform as a Service, and serverless computing environments. Alongside a set of management tools, it provides a series of modular cloud services including computing, data storage, data analytics and machine learning.
A python script for upload Online File to Google Cloud Storage (GCS) built on Docker
Stream CSV data from Google Cloud Storage to BigQuery using Apache Beam Dataflow, featuring dynamic schema detection and flexible runner options.
Use Bigquery Python Package
Analysis of NYC's citibike data. Technologies: Python , Prefect, dbt, Terraform , Looker data studio
Data engineering project for TLC taxi Parquet data following an ELT model (extraction, load, transform)
A reference implementation of Vertex Pipelines for creating a production-ready MLOps solution on Google Cloud.
Apache Beam pipeline to analyze London bicycle hiring dataset with GCP Dataflow
Map Reduce system using Google Cloud Functions to Fetch data which contains large number of text files, compute inverted index of text, and Expose a simple web-based search interface
Air Quality data analysis as a proof of concept for the Data Engineering Zoomcamp course from DataTalks.Club, using Prefect, Spark, GCP, Terraform and more.
Using Google Cloud Logging to write application logs
[Package] Configure environment variables from Google Cloud Secret Manager
Flask app for Obama or Smalling prediction on GCP
Released April 7, 2008