BigQuery
Google BigQuery enables companies to handle large amounts of data without having to manage infrastructure. Google’s documentation describes it as a « serverless architecture (that) lets you use SQL queries to answer your organization's biggest questions with zero infrastructure management. BigQuery's scalable, distributed analysis engine lets you query terabytes in seconds and petabytes in minutes. » Its client libraries allow the use of widely known languages such as Python, Java, JavaScript, and Go. Federated queries are also supported, making it flexible to read data from external sources.
📖 A highly rated canonical book on it is « Google BigQuery: The Definitive Guide », a comprehensive reference.
Another enriching read on the subject is the inside story told in the article by the founding product manager of BigQuery celebrating its 10th anniversary.
Here are 29 public repositories matching this topic...
Terraform module of Google BigQuery S3 Data Transfer Config
-
Updated
Oct 22, 2019 - HCL
Here we are have automated the entire process of Creation of Google Cloud Storage buckets to store that that we are transferring via various transfer services, as of now Transfer from other Google cloud Storage buckets and public http/https links are supported, finally all this data is being processed into BigQuery for observations and Analysis.
-
Updated
Dec 27, 2019 - HCL
Simple HTTP endpoint for telemetry data type events in GCP.
-
Updated
Nov 23, 2020 - HCL
A IaC script to ingest and process messages containing data of trips taken by vehicles.
-
Updated
May 10, 2021 - HCL
This is a demo project to use Terraform to manage BigQuery scheduled queries with Cloud Build CI/CD
-
Updated
Aug 25, 2021 - HCL
Dataflow job subscriber to PubSub subscription. It takes message from subscription and push it into BigQuery table.
-
Updated
Oct 23, 2021 - HCL
Cloud function subscribes itself to given topic and inserts each message to BigQuery table.
-
Updated
Dec 1, 2021 - HCL
Automatic Anomaly Decetor
-
Updated
Jan 11, 2022 - HCL
Use GCP Datastream to incrementally load PostgreSQL to BigQuery
-
Updated
Oct 6, 2022 - HCL
Data sync via CDC from GCP Cloud SQL to Big Query using Datastream
-
Updated
Feb 9, 2023 - HCL
A terraform module to copy BigQuery datasets across regions
-
Updated
Mar 18, 2023 - HCL
Final project for DataTalks.Club Data Engineering bootcamp
-
Updated
Apr 7, 2023 - HCL
Yelp Data Processing Pipeline on GCP
-
Updated
Apr 16, 2023 - HCL
Creating datasets and tables in Google BigQuery via Terraform
-
Updated
Apr 20, 2023 - HCL
This module allows you to execute sql queries in big queries, simply by specifying the list of sql files (in the source bucket) to be executed, the result of which is then stored in the result bucket.
-
Updated
May 31, 2023 - HCL
Released May 19, 2010
- Followers
- 48 followers
- Repository
- GoogleCloudPlatform/bigquery-utils
- Website
- cloud.google.com/bigquery
- Wikipedia
- Wikipedia