This is a small Dataflow Job that receives a message via pubsub every time someone accesses a shortened URL. It accumulates the items using a Fixed Time Window, groups by Id and updates FireStore with the amount of clicks

A general framework for optimizing DNN dataflow on systolic array

Monorepo which holds the code and documentation for CW2 of the COMP3011 module.

Predictive Traffic Analysis with Google Cloud Platforms

analyze sql statement data flow

Python class to build an API request

Analyze the total volume of off-chip data communication and reduce it using loop tiling and loop ordering. The idea comes from SmartShuttle.

e-commerce

Dataflow Simple Sample (TSV in GCS to BigQUery)

This is my example to process data from application into data warehouse.

Python Dataflow Programming Library

Code for Pento's blog post Scaling Computer Vision models with Dataflow.

A command argument templatizer

simple telegram bot for test dialogflow and like replays in chat

Apache Beam pipeline to analyze London bicycle hiring dataset with GCP Dataflow

Python runtime for Flyde - visual flow-based programming language and IDE

A streaming version of the Unbabel's BEC using GCP Pub/Sub and Apache Beam.

Google Dataflow Flex Templates (in Python) for large scale Graph Loading with GDS and Apache Arrow

代码定义威胁建模 Threat Model By Code -- 提升SDL活动效能

Connect Four Data Engineering Project: leveraging GCS for scalable and durable storage, Dataflow for data extraction and transformation, BigQuery as the data repository, Slack Integration for real-time sharing, Looker for insightful reports and visualizations, and Email Scheduler for automated report delivery.