This repository has been archived by the owner on Feb 11, 2018. It is now read-only.
How to know when all inserts are done #8
Comments
oryband
added a commit
that referenced
this issue
Aug 28, 2016
- easier to grasp (and use) types:
- add SyncWorker type, which provides blocking streaming.
this is instead of Streamer type
- asyncWorker, which wraps SyncWorker and provides asynchronous
streaming
- AsyncWorkerGroup, which manages multiple asyncWorkers.
this is isntead of MultiStreamer type
- add insert error type heirarchy. this provides a way to know when an insert
operation has occurred, how many retries have been made,
and whether the insert has succeeded or not, fixes #8
- enqueuing rows now support passing insert ids, fixes #7, fixes #11
- add support for SkipInvalidRows and IgnoreUnknownValues:
https://cloud.google.com/bigquery/docs/reference/v2/tabledata/insertAll#request-body
- switch to use functional options when passing arguments to New()
constructor functions
- add option to automatically retry/not retry (with backoff)
when executing insert operations
- update, add examples
oryband
added a commit
that referenced
this issue
Aug 28, 2016
- easier to grasp (and use) types:
- add SyncWorker type, which provides blocking streaming.
this is instead of Streamer type
- asyncWorker, which wraps SyncWorker and provides asynchronous
streaming
- AsyncWorkerGroup, which manages multiple asyncWorkers.
this is isntead of MultiStreamer type
- add insert error type heirarchy. this provides a way to know when an insert
operation has occurred, how many retries have been made,
and whether the insert has succeeded or not, fixes #8
- enqueuing rows now support passing insert ids, fixes #7, fixes #11
- add support for SkipInvalidRows and IgnoreUnknownValues:
https://cloud.google.com/bigquery/docs/reference/v2/tabledata/insertAll#request-body
- switch to use functional options when passing arguments to New()
constructor functions
- add option to automatically retry/not retry (with backoff)
when executing insert operations
- update, add examples
oryband
added a commit
that referenced
this issue
Aug 28, 2016
- easier to grasp (and use) types:
- add SyncWorker type, which provides blocking streaming.
this is instead of Streamer type
- asyncWorker, which wraps SyncWorker and provides asynchronous
streaming
- AsyncWorkerGroup, which manages multiple asyncWorkers.
this is isntead of MultiStreamer type
- add insert error type heirarchy. this provides a way to know when an insert
operation has occurred, how many retries have been made,
and whether the insert has succeeded or not, fixes #8
- enqueuing rows now support passing insert ids, fixes #7, fixes #11
- add support for SkipInvalidRows and IgnoreUnknownValues:
https://cloud.google.com/bigquery/docs/reference/v2/tabledata/insertAll#request-body
- switch to use functional options when passing arguments to New()
constructor functions
- add option to automatically retry/not retry (with backoff)
when executing insert operations
- update, add examples
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
Hi, first of all, amazing library.
I have been working with it for a few days and I have seen that
MultiStreamer.Stopis not synchronous, leading to the possibility that rows are not imported when the program finishes.So, is there a way to know when all rows have been inserted? Right now I have a dirty patch to make
Stopsync but I'd like to know if there is an official way to do this or is planned to be implemented.Cheers!
The text was updated successfully, but these errors were encountered: