Demonstrating Apache Beam capabilities with GCP Pub/Sub, BigQuery and Storage
-
Updated
Jan 10, 2020 - Python
Demonstrating Apache Beam capabilities with GCP Pub/Sub, BigQuery and Storage
Project that runs in GCP using Big Query and Cloud Functions services, this pipeline is an ETL process that leaves the information ready to apply different analyzes.
ecommerce GCP Streaming pipeline ― Cloud Storage, Compute Engine, Pub/Sub, Dataflow, Apache Beam, BigQuery and Tableau; GCP Batch pipeline ― Cloud Storage, Dataproc, PySpark, Cloud Spanner and Tableau
SEVIR Lambda functions for Summarization and Named-Entity Recognition. Deployed on AWS ECR.
Black Friday, the biggest shopping day of the year, presents a unique opportunity for retailers like Walmart to boost sales, attract new customers, and clear inventory. Managing the surge in transaction volumes, understanding customer preferences, and optimizing inventory in real time are critical challenges that require sophisticated data solution
Add a description, image, and links to the gcp-bigquery topic page so that developers can more easily learn about it.
To associate your repository with the gcp-bigquery topic, visit your repo's landing page and select "manage topics."