Destination snowflake: mostly done implementations for sqlgenerator+destinationhandler

[Edward Gao (edgao)]

SnowflakeSqlGeneratorIntegrationTest is now fully passing. There's a few things that still need to happen before we can release to beta. I'll do those in followup PRs / submit more issues for these:

• enabling the T+D tests + getting the e2e flow working
• specific type mappings - compare these with legacy normalization (Destination Snowflake v2: doublecheck type mapping #29072)
• adding support for more timezone formats when parsing timestamptz (and time_with_timezone?)
• add a test class + GSM secret to verify that we can override the raw table schema
• figure out snowflake clustering - should we even do this? (https://github.com/airbytehq/airbyte-internal-issues/issues/2022))
• identifier transformations (handling reserved words, special characters, etc) - we might be OK since we're quoting everything, but we should confirm
• disable 1s1t on gcs/s3 staging

[Evan Tahler (evantahler)]

Note for the future: INT in snowflake is the same as NUMBER, which is the same as NUMBER(38,0) - https://docs.snowflake.com/en/sql-reference/data-types-numeric#int-integer-bigint-smallint-tinyint-byteint

nit: It might be better to write BIGINT, and always pass this alais down to snowflake

[Edward Gao (edgao)]

looks like NUMBER is snowflake's internal name (i.e. what you get from querying information_schema.columns), using that everywhere 🤷

[Edward Gao (edgao)]

(feel free to rereview, otherwise I'll merge on monday)

[Octavia Squidington III (octavia-squidington-iii)]

destination-bigquery test report (commit 95cb31008d) - ✅

⏲️ Total pipeline duration: 32mn48s

Step	Result
Validate airbyte-integrations/connectors/destination-bigquery/metadata.yaml	✅
Connector version semver check	✅
QA checks	✅
Build connector tar	✅
Build destination-bigquery docker image for platform linux/x86_64	✅
Build airbyte/normalization:dev	✅
./gradlew :airbyte-integrations:connectors:destination-bigquery:integrationTest	✅

🔗 View the logs here

☁️ View runs for commit in Dagger Cloud

Please note that tests are only run on PR ready for review. Please set your PR to draft mode to not flood the CI engine and upstream service on following commits.
You can run the same pipeline locally on this branch with the airbyte-ci tool with the following command

airbyte-ci connectors --name=destination-bigquery test

[Octavia Squidington III (octavia-squidington-iii)]

destination-snowflake test report (commit 95cb31008d) - ✅

⏲️ Total pipeline duration: 42mn54s

Step	Result
Validate airbyte-integrations/connectors/destination-snowflake/metadata.yaml	✅
Connector version semver check	✅
Connector version increment check	✅
QA checks	✅
Build connector tar	✅
Build destination-snowflake docker image for platform linux/x86_64	✅
Build airbyte/normalization-snowflake:dev	✅
./gradlew :airbyte-integrations:connectors:destination-snowflake:integrationTest	✅

🔗 View the logs here

☁️ View runs for commit in Dagger Cloud

Please note that tests are only run on PR ready for review. Please set your PR to draft mode to not flood the CI engine and upstream service on following commits.
You can run the same pipeline locally on this branch with the airbyte-ci tool with the following command

airbyte-ci connectors --name=destination-snowflake test

[Octavia Squidington III (octavia-squidington-iii)]

destination-bigquery test report (commit 95cb31008d) - ✅

⏲️ Total pipeline duration: 04mn02s

Step	Result
Validate airbyte-integrations/connectors/destination-bigquery/metadata.yaml	✅
Connector version semver check	✅
QA checks	✅
Build connector tar	✅
Build destination-bigquery docker image for platform linux/x86_64	✅
Build airbyte/normalization:dev	✅
./gradlew :airbyte-integrations:connectors:destination-bigquery:integrationTest	✅

🔗 View the logs here

☁️ View runs for commit in Dagger Cloud

Please note that tests are only run on PR ready for review. Please set your PR to draft mode to not flood the CI engine and upstream service on following commits.
You can run the same pipeline locally on this branch with the airbyte-ci tool with the following command

airbyte-ci connectors --name=destination-bigquery test

[Octavia Squidington III (octavia-squidington-iii)]

destination-snowflake test report (commit 95cb31008d) - ✅

⏲️ Total pipeline duration: 42mn13s

Step	Result
Validate airbyte-integrations/connectors/destination-snowflake/metadata.yaml	✅
Connector version semver check	✅
Connector version increment check	✅
QA checks	✅
Build connector tar	✅
Build destination-snowflake docker image for platform linux/x86_64	✅
Build airbyte/normalization-snowflake:dev	✅
./gradlew :airbyte-integrations:connectors:destination-snowflake:integrationTest	✅

🔗 View the logs here

☁️ View runs for commit in Dagger Cloud

Please note that tests are only run on PR ready for review. Please set your PR to draft mode to not flood the CI engine and upstream service on following commits.
You can run the same pipeline locally on this branch with the airbyte-ci tool with the following command

airbyte-ci connectors --name=destination-snowflake test