Skip to content
Uses Cloud Build to deploy a scalable batch ingestion pipeline consisting of GCS, Cloud Functions, Dataflow and BigQuery
Java JavaScript HCL
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
cloud-function
gradle/wrapper
src
terraform
.gitignore
LICENSE
README.md
build.gradle
cloudbuild.yaml
gradle.properties
gradlew
gradlew.bat

README.md

Uses Cloud Build to deploy a scalable batch ingestion pipeline consisting of GCS, Cloud Functions, Dataflow and BigQuery

See cloudbuild.yaml for an idea of what this CI/CD pipeline does. Essentially it runs a container for each step of the build using Cloud Build and deploys each component of the pipeline to GCP. It also uses Terraform to create the initial buckets for deploying all the binaries to. See the infra.tf file for all that nonsense.

Here's what it looks like:

screen shot 2018-09-04 at 5 33 17 pm

You can’t perform that action at this time.