An end to end anime recommendation system based on data scrapped from myanimelist.net

This is a simple action that helps you to fetch your Apache Airflow DAGs to Google Cloud Composer

Python framework for building Google Cloud Composer workflows.

Quick start setup, best practices for constructing DAGs, configuration, deployment, and utilizing essential operators for effective workflows are all covered in this repository's useful manual for using Apache Airflow.

Boilerplate for batch-processing scenarios' orchestration. Apache Airflow w/ realistic product analytics use case

Leveraged GitHub Actions to automate the deployment of a GCP pipeline for Snowflake to BigQuery data migration. Utilized 'sensex-data-analysis' as the data source and Snowflake storage integration feature to load data to GCS. Implemented workflow management and transformation using Composer (Airflow) and Dataflow