Skip to content
master
Switch branches/tags
Go to file
Code

Latest commit

 

Git stats

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
 
 
 
 
 
 
 
 
 
 
 
 

nsq to bigquery logo

Build Status

nsq-to-bigquery

Stream NSQ messages to Google's BigQuery using the streaming API.

Written by Eran Sandler (@erans)

This is a very early version that does work but was not (yet) tested in real hard production environment.

Assumptions / Limitations:

  • Message body is a valid JSON that is a flat dictionary (only key and simple values).
  • Each message must contain data that will constitute a single row that will go into BigQuery.
  • BigQuery table MUST exists and the schema MUST match the JSON being sent.
  • This version sends each message in its own request and does not use any batch API (yet).

About

Stream NSQ messages to Google's BigQuery using the streaming API

Resources

License

Releases

No releases published

Packages

No packages published