Destinations supporting refreshes: Resuming truncate refresh incorrectly skips T+D if the resumed sync emits no records

[edgao]

Connector Name

destination-bigquery + destination-snowflake

Connector Version

2.8.1

What step the error happened?

During the sync

Relevant information

example:

1. Attempt 1 of a truncate refresh emits 10 records, then crashes without emitting a stream COMPLETE status. We write these to a temp raw table, and skip T+D.
2. Attempt 2 emits 0 records. This check will skip T+D.
3. We then overwrite the final table with an empty final table.

to fix: truncate syncs should also check the temp raw table initial status for whether there were preexisting records.

Relevant log output

No response

Contribute

• Yes, I want to contribute