[EPIC] Destination Redshift to GA

[alexandr-shegeda]

The main purpose of this issue is to track release progress for the connector.

Acceptance criteria

• Create a checklist document that should be placed on the Google Drive
• Checklist filled up by engineering team
• Collect and list all tech debt-related issues in the section below
• Create/Revise MLP document and place it here
• Move checklist to the unblockers team
• Reviewed/Updated by unblockers team
• Move checklist to the product team for review
• Reviewed/Updated by product team
• Update connector documentation according to the comments in the checklist
• Certification completed

Outstanding Bugs

• Destination Redshift, Postgres and Snowflake: not able to handle - in namespace/stream name #6340
• airbytehq/airbyte-internal-issues#457
• Destination Redshift: improve check performance #11580
• All Syncs with redshift destination 0.3.32 fail rollback to version 0.3.28 resolves the issue #12265
• Add "Loading Method" option to Redshift Destination spec #12709
• Destination Redshift fails after upgrade #12843

MLP section

• airbytehq/airbyte-internal-issues#280
• Stripe to Redshift Sync failing with error (Airbyte: 0.34.4-alpha Stipe: 0.1.25 Redshift: 0.3.23) #9038
• airbytehq/airbyte-internal-issues#531
• Redshift destination performance improvements #4871
• [EPIC] Verify DB System tables and tables where user do not have privileges are not accessible to the user at Airbyte UI #8045
• Apply buffering changes to Redshift Destination  #11426
• Redshift Destination implement SSH tunneling #12131
• Redshift Destination Authentication gaps #12132

[misteryeo]

@lazebnyi reviewed your latest updates to the checklist. For clarity, check_performances always block Beta/GA.

[misteryeo]

@lazebnyi reviewed checklist again - LGTM except two things:

• Redshift Destination: update spec #12100 doesn't seem to appear in production
• Destination Redshift: improve check performance #11580 unsure what's happening here since there are open comments on the PR from 2 weeks ago?

[lazebnyi]

@misteryeo I think that's questions to @alexandr-shegeda 🙂

[VitaliiMaltsev]

reviewed checklist again - LGTM except two things:

• Redshift Destination: update spec #12100 doesn't seem to appear in production
• Destination Redshift: improve check performance #11580 unsure what's happening here since there are open comments on the PR from 2 weeks ago?

• Redshift Destination: update spec #12100 - i'm not sure if these changers were released in the new cloud or oss versions, but those changes were definitely merged in the master
• Destination Redshift: improve check performance #11580 - the PR is currently in Airbyte review status, outstanding comments were replied today

[misteryeo]

@VitaliiMaltsev Thanks for confirming on #12100 - I can see that it's been merged into master but we need to ensure that this is reflected in production for our users. Can you investigate and make sure this is the case?

cc: @alexandr-shegeda

[VitaliiMaltsev]

@VitaliiMaltsev Thanks for confirming on #12100 - I can see that it's been merged into master but we need to ensure that this is reflected in production for our users. Can you investigate and make sure this is the case?

cc: @alexandr-shegeda

@misteryeo after my consultation with @girarda - the new version with updated spec could be deployed in the cloud when this task is resolved

[mattyweb]

Can #14441 get added to the Redshift GA list? It would be one thing if it only truncated data or skipped a row but currently it appears if there is even 1 row of VARCHAR data around 65535 in length the whole process blows up...

[evantahler]

Closing in favor of https://github.com/airbytehq/airbyte-internal-issues/issues/2386