馃悰 Destination Snowflake: duplicate rows on retries when using incremental staging #8832
Labels
area/connectors
Connector related issues
community
connectors/destination/snowflake
connectors/destinations-warehouse
priority/critical
Critical priority!
type/bug
Something isn't working
Environment
Current Behavior
When creating a new sync, if the sync fails and it has to retry, all rows which have already been put on the stage will then have rows appended again to the stage. So there are duplicate rows.
Expected Behavior
It should not have duplicate rows.
The stage should have a folder in it, as mentioned here https://docs.snowflake.com/en/user-guide/data-load-local-file-system-stage.html:
This way the uuid is used just for that sync, and other retries should then use a new UUID. On failure it should delete files from that uuid.
Attempt 1:
Attempt 2:
Steps to Reproduce
Are you willing to submit a PR?
Maybe?
The text was updated successfully, but these errors were encountered: