A test space where I'm learning ETL operations using Airflow and the Google Cloud Platform
-
Updated
Jul 15, 2021
A test space where I'm learning ETL operations using Airflow and the Google Cloud Platform
Website to convert a schema from one format to another between BigQuery and Avro
Stream CSV data from Google Cloud Storage to BigQuery using Apache Beam Dataflow, featuring dynamic schema detection and flexible runner options.
Read step by step tutorial here: https://frazynondo.medium.com/etl-with-gcp-part-i-apache-beam-eclipse-gcs-and-bigquery-dc9529ee7f19
A protocol buffer compiler (protoc) plugin for generating Google BigQuery JSON table definitions.
Hackolade(https://hackolade.com) plugin for BigQuery
Simple PHP Big Query With PHP
Analytics on Uber Data
(Script) Generates SQL query that selects all fields (recursively for nested fields) from the provided BigQuery schema file.
Schema Registry for BigQuery
This is the sentiment analysis on the #VisitRwanda on twitter, this is a campaign of eco tourism in Rwanda that promotes touristic places attraction in Rwanda.
Python library to convert google bigquery table schema to jsonschema
python script to scrap AEMO data
bq-schema-validator is a CLI tool to detect the log entry that causes a BigQuery table schema error via log sink.
Convert Zod to BigQuery Schema
Python lib and cli tool to convert MySQL schemas into BigQuery schemas
Add a description, image, and links to the bigquery-schema topic page so that developers can more easily learn about it.
To associate your repository with the bigquery-schema topic, visit your repo's landing page and select "manage topics."