🐛 Destination v2 general availability by jbfbell · Pull Request #29636 · airbytehq/airbyte

Joe Bell (jbfbell) · 2023-08-18T23:05:59Z

changelogs:

bigquery:

Add support for incremental/dedup on streams with no explicit cursor (e.g. source-postgres xmin)
Change raw table format to preserve high-precision numeric values

snowflake

Add support for incremental/dedup on streams with no explicit cursor (e.g. source-postgres xmin)

github-actions · 2023-08-18T23:06:19Z

Before Merging a Connector Pull Request

Wow! What a great pull request you have here! 🎉

To merge this PR, ensure the following has been done/considered for each connector added or updated:

PR name follows PR naming conventions
Breaking changes are considered. If a Breaking Change is being introduced, ensure an Airbyte engineer has created a Breaking Change Plan.
Connector version has been incremented in the Dockerfile and metadata.yaml according to our Semantic Versioning for Connectors guidelines
You've updated the connector's metadata.yaml file any other relevant changes, including a breakingChanges entry for major version bumps. See metadata.yaml docs
Secrets in the connector's spec are annotated with airbyte_secret
All documentation files are up to date. (README.md, bootstrap.md, docs.md, etc...)
Changelog updated in docs/integrations/<source or destination>/<name>.md with an entry for the new version. See changelog example
Migration guide updated in docs/integrations/<source or destination>/<name>-migrations.md with an entry for the new version, if the version is a breaking change. See migration guide example
If set, you've ensured the icon is present in the platform-internal repo. (Docs)

If the checklist is complete, but the CI check is failing,

Check for hidden checklists in your PR description
Toggle the github label checklist-action-run on/off to re-run the checklist CI.

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com> Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>

Co-authored-by: Jonathan Pearlin <jonathan@airbyte.io> Co-authored-by: Jose Pefaur <jose.pefaur@gmail.com>

Co-authored-by: edgao <edgao@users.noreply.github.com>

…ring to preserve number precision (#29590) Co-authored-by: edgao <edgao@users.noreply.github.com>

Co-authored-by: jbfbell <jbfbell@users.noreply.github.com> Co-authored-by: Edward Gao <edward.gao@airbyte.io> Co-authored-by: edgao <edgao@users.noreply.github.com>

Co-authored-by: edgao <edgao@users.noreply.github.com>

github-actions · 2023-08-23T18:44:37Z

destination-bigquery test report (commit `9986532032`) - ✅

⏲️ Total pipeline duration: 35mn02s

Step	Result
Java Connector Unit Tests	✅
Build connector tar	✅
Build destination-bigquery docker image for platform linux/x86_64	✅
Build airbyte/normalization:dev	✅
Java Connector Integration Tests	✅
Validate airbyte-integrations/connectors/destination-bigquery/metadata.yaml	✅
Connector version semver check	✅
Connector version increment check	✅
QA checks	✅

🔗 View the logs here

☁️ View runs for commit in Dagger Cloud

Please note that tests are only run on PR ready for review. Please set your PR to draft mode to not flood the CI engine and upstream service on following commits.
You can run the same pipeline locally on this branch with the airbyte-ci tool with the following command

airbyte-ci connectors --name=destination-bigquery test

github-actions · 2023-08-23T19:18:08Z

destination-snowflake test report (commit `9986532032`) - ✅

⏲️ Total pipeline duration: 33mn19s

Step	Result
Java Connector Unit Tests	✅
Build connector tar	✅
Build destination-snowflake docker image for platform linux/x86_64	✅
Build airbyte/normalization-snowflake:dev	✅
Java Connector Integration Tests	✅
Validate airbyte-integrations/connectors/destination-snowflake/metadata.yaml	✅
Connector version semver check	✅
Connector version increment check	✅
QA checks	✅

🔗 View the logs here

☁️ View runs for commit in Dagger Cloud

Please note that tests are only run on PR ready for review. Please set your PR to draft mode to not flood the CI engine and upstream service on following commits.
You can run the same pipeline locally on this branch with the airbyte-ci tool with the following command

airbyte-ci connectors --name=destination-snowflake test

Edward Gao (edgao) · 2023-08-23T19:33:45Z

/approve-and-merge reason="build was successful on last real commit; autoformat commit didn't trigger PR checks"

Octavia The Approver (octavia-approvington) · 2023-08-23T19:34:21Z

It's time

Co-authored-by: Edward Gao <edward.gao@airbyte.io> Co-authored-by: btkcodedev <btk.codedev@gmail.com> Co-authored-by: marcosmarxm <marcosmarxm@gmail.com> Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com> Co-authored-by: Cole Snodgrass <cole@airbyte.io> Co-authored-by: Jonathan Pearlin <jonathan@airbyte.io> Co-authored-by: Jose Pefaur <jose.pefaur@gmail.com> Co-authored-by: Sujay Khandekar <sskhandek@gmail.com> Co-authored-by: edgao <edgao@users.noreply.github.com> Co-authored-by: jbfbell <jbfbell@users.noreply.github.com>

version bumps

e028818

Octavia Squidington III (octavia-squidington-iii) added area/connectors Connector related issues area/documentation Improvements or additions to documentation connectors/destination/bigquery connectors/destination/snowflake labels Aug 18, 2023

Edward Gao (edgao) and others added 6 commits August 21, 2023 07:38

Merge branch 'master' into destinations-v2-sf-bq-release

e69595b

✨Source Appfollow: Migrate Python CDK to Low-code CDK (#29128)

ec2304b

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com> Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>

✨ Source Mongodb POC: add read support (#29066)

630a3f5

Co-authored-by: Jonathan Pearlin <jonathan@airbyte.io> Co-authored-by: Jose Pefaur <jose.pefaur@gmail.com>

Update Orb links on the Orb Page (#29635)

62046b7

merge conflict

3f7dcf6

merge conflict

3618f90

Octavia Squidington III (octavia-squidington-iii) added CDK Connector Development Kit connectors/source/postgres connectors/source/relational-db connectors/source/appfollow connectors/source/mongodb-internal-poc labels Aug 21, 2023

Merge branch 'master' into destinations-v2-sf-bq-release

5195bc7

Octavia Squidington III (octavia-squidington-iii) removed the CDK Connector Development Kit label Aug 21, 2023

Edward Gao (edgao) and others added 9 commits August 21, 2023 14:42

🐛 Destinations v2: support dedup without cursor (#29637)

b543b77

Co-authored-by: edgao <edgao@users.noreply.github.com>

Merge branch 'master' into destinations-v2-sf-bq-release

371532a

Destination bigquery v2: Switch raw table to store airbyte_data as st…

982e844

…ring to preserve number precision (#29590) Co-authored-by: edgao <edgao@users.noreply.github.com>

Merge branch 'master' into destinations-v2-sf-bq-release

be75dd4

deserialize raw data

3cd2ae8

Destination Snowflake - add v1v2 migration (#29601)

065afe4

Co-authored-by: jbfbell <jbfbell@users.noreply.github.com> Co-authored-by: Edward Gao <edward.gao@airbyte.io> Co-authored-by: edgao <edgao@users.noreply.github.com>

Merge branch 'master' into destinations-v2-sf-bq-release

99f12ae

Automated Commit - Format and Process Resources Changes

731c80e

Merge branch 'master' into destinations-v2-sf-bq-release

13f181d

Edward Gao (edgao) marked this pull request as ready for review August 22, 2023 20:35

Edward Gao (edgao) requested a review from a team as a code owner August 22, 2023 20:35

This comment was marked as outdated.

Sign in to view

fix bigquery test

38f747d

This comment was marked as outdated.

Sign in to view

Merge branch 'master' into destinations-v2-sf-bq-release

f66407d

Edward Gao (edgao) mentioned this pull request Aug 23, 2023

🐛 Destinations v2: Force tmp table creation #29664

Merged

🐛 Destinations v2: Force tmp table creation (#29664)

d39f6e6

This comment was marked as outdated.

Sign in to view

Edward Gao (edgao) and others added 2 commits August 23, 2023 10:36

Destinations v2: skip T+D calls if setup failed (#29762)

1c900fd

🐛 Destinations v2: improve behavior with special characters (#29685)

695bbfa

Co-authored-by: edgao <edgao@users.noreply.github.com>

Edward Gao (edgao) changed the title ~~Destination v2 general availability~~ 🐛 Destination v2 general availability Aug 23, 2023

changelog entries

f8b4b47

Edward Gao (edgao) approved these changes Aug 23, 2023

View reviewed changes

Edward Gao (edgao) enabled auto-merge (squash) August 23, 2023 17:53

Edward Gao (edgao) added the checklist-action-run label Aug 23, 2023

This comment was marked as outdated.

Sign in to view

fix build... which should have been broken previously?

9986532

This comment was marked as outdated.

Sign in to view

Automated Commit - Format and Process Resources Changes

5b3c46e

Octavia The Approver (octavia-approvington) approved these changes Aug 23, 2023

View reviewed changes

Octavia The Approver (octavia-approvington) merged commit cd5671c into master Aug 23, 2023

Octavia The Approver (octavia-approvington) deleted the destinations-v2-sf-bq-release branch August 23, 2023 19:34

Navigation Menu

Uh oh!

🐛 Destination v2 general availability - #29636

🐛 Destination v2 general availability#29636
Octavia The Approver (octavia-approvington) merged 27 commits into
masterfrom
destinations-v2-sf-bq-release

Joe Bell (jbfbell) commented Aug 18, 2023 •

edited by edgao

Loading

Uh oh!

github-actions Bot commented Aug 18, 2023 •

edited by edgao

Loading

Uh oh!

This comment was marked as outdated.

This comment was marked as outdated.

This comment was marked as outdated.

This comment was marked as outdated.

This comment was marked as outdated.

This comment was marked as outdated.

This comment was marked as outdated.

This comment was marked as outdated.

This comment was marked as outdated.

github-actions Bot commented Aug 23, 2023

Uh oh!

github-actions Bot commented Aug 23, 2023

Uh oh!

Edward Gao (edgao) commented Aug 23, 2023

Uh oh!

Octavia The Approver (octavia-approvington) commented Aug 23, 2023

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

7 participants

Uh oh!

Conversation

Joe Bell (jbfbell) commented Aug 18, 2023 • edited by edgao Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Aug 18, 2023 • edited by edgao Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Before Merging a Connector Pull Request

Uh oh!

This comment was marked as outdated.

This comment was marked as outdated.

This comment was marked as outdated.

This comment was marked as outdated.

This comment was marked as outdated.

This comment was marked as outdated.

This comment was marked as outdated.

This comment was marked as outdated.

This comment was marked as outdated.

github-actions Bot commented Aug 23, 2023

destination-bigquery test report (commit 9986532032) - ✅

Uh oh!

github-actions Bot commented Aug 23, 2023

destination-snowflake test report (commit 9986532032) - ✅

Uh oh!

Edward Gao (edgao) commented Aug 23, 2023

Uh oh!

Octavia The Approver (octavia-approvington) commented Aug 23, 2023

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

7 participants

Joe Bell (jbfbell) commented Aug 18, 2023 •

edited by edgao

Loading

github-actions Bot commented Aug 18, 2023 •

edited by edgao

Loading

destination-bigquery test report (commit `9986532032`) - ✅

destination-snowflake test report (commit `9986532032`) - ✅