Fetch data weekly using ETL approach from tommorow.io weather forecast data.
-
Updated
Jul 21, 2024 - Python
Fetch data weekly using ETL approach from tommorow.io weather forecast data.
Collection of Tools, Workflows and Processes to help Facilitate Archiving Scientific Data.
An Ansible module to map cloud-specific (AWS, GCP and Azure) block device names (e.g. /dev/sdf) with the volume provided to the OS.
A Free and fast Drive Solution with custom DB Support for GCP and AWS S3. ⚡️
Local emulator for Google Cloud Storage
Handle files? Ok.
Handy python codes
Download Sentinel 2 (L1C & L2A) from GCP without authentication.
A Blog Site built with Nuxt, post hosted on django, images hosted to GCP
MutableMapping implementations for common cloud storage solutions - use a bucket as a dict!
Repositorio para realizar el curso en Udemy llamado "Airflow2.0 De 0 a Héroe", de la academia "Datapath".
Python web scraping pipeline orchestrated with Airflow
Alpaca AI Paper-trading bot using Python
A Python package to enrich Google Cloud Data Catalog Fileset Entries with tags.
A Python package to centralize some Google Cloud Data Catalog scripts, this repo contains commands like bulk CSV operations that help leverage Data Catalog features.
A guide on how to use Python to extract XML files from an SFTP server, back them up to Google Cloud Storage, and process them — all without spinning up a virtual machine.
Extract, transform and load various news data to find out top 5 words using Airflow as a orchestrator.
Simple API to copy files to and from Google Cloud Storage
ecommerce GCP Streaming pipeline ― Cloud Storage, Compute Engine, Pub/Sub, Dataflow, Apache Beam, BigQuery and Tableau; GCP Batch pipeline ― Cloud Storage, Dataproc, PySpark, Cloud Spanner and Tableau
Project that runs in GCP using Big Query and Cloud Functions services, this pipeline is an ETL process that leaves the information ready to apply different analyzes.
Add a description, image, and links to the gcp-storage topic page so that developers can more easily learn about it.
To associate your repository with the gcp-storage topic, visit your repo's landing page and select "manage topics."