bump cdk version for postgres, mysql sources by rodireich · Pull Request #31322 · airbytehq/airbyte

Rodi Reich Zilberman (rodireich) · 2023-10-11T22:08:43Z

What

Bump the java cdk version to 0.1.8,
And point source postgres and mysql to newly published version, and their respective strict encrypt.
This is to resolve #30781.

How

Bump version, publish cdk,
update connectors build.gradle.

vercel · 2023-10-11T22:08:50Z

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Ignored Deployment

Name	Status	Preview	Comments	Updated (UTC)
airbyte-docs	⬜️ Ignored (Inspect)	Visit Preview		Oct 12, 2023 4:03am

github-actions · 2023-10-11T22:09:12Z

Before Merging a Connector Pull Request

Wow! What a great pull request you have here! 🎉

To merge this PR, ensure the following has been done/considered for each connector added or updated:

PR name follows PR naming conventions
Breaking changes are considered. If a Breaking Change is being introduced, ensure an Airbyte engineer has created a Breaking Change Plan.
Connector version has been incremented in the Dockerfile and metadata.yaml according to our Semantic Versioning for Connectors guidelines
You've updated the connector's metadata.yaml file any other relevant changes, including a breakingChanges entry for major version bumps. See metadata.yaml docs
Secrets in the connector's spec are annotated with airbyte_secret
All documentation files are up to date. (README.md, bootstrap.md, docs.md, etc...)
Changelog updated in docs/integrations/<source or destination>/<name>.md with an entry for the new version. See changelog example
Migration guide updated in docs/integrations/<source or destination>/<name>-migrations.md with an entry for the new version, if the version is a breaking change. See migration guide example
If set, you've ensured the icon is present in the platform-internal repo. (Docs)

If the checklist is complete, but the CI check is failing,

Check for hidden checklists in your PR description
Toggle the github label checklist-action-run on/off to re-run the checklist CI.

Rodi Reich Zilberman (rodireich) · 2023-10-11T22:22:46Z

/publish-java-cdk dry-run=true

🕑 https://github.com/airbytehq/airbyte/actions/runs/6488648238
✅ Successfully published Java CDK version=0.1.8!

Akash Kulkarni (akashkulk) · 2023-10-11T22:29:55Z


 | Version | Date       | Pull Request                                               | Subject                                                                                                                                                        |
 |:--------|:-----------|:-----------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------|
+| 0.1.8   | 2023-10-11 | [\#31322](https://github.com/airbytehq/airbyte/pull/31322) | Cap log line length to 32KB to prevent loss of records                                                                                                          |


Should this be updated to the PR that actually introduced the change?

Ideally it would have been the same one. but because of the time that passed I forgot this was in the CDK.
I referred to this one in case someone needs to reconstruct the chain of events and mentioned the issue in description.

Rodi Reich Zilberman (rodireich) · 2023-10-11T22:37:59Z

/publish-java-cdk

🕑 https://github.com/airbytehq/airbyte/actions/runs/6488774423
✅ Successfully published Java CDK version=0.1.8!

airbyte-oss-build-runner · 2023-10-11T23:30:10Z

source-mysql-strict-encrypt test report (commit `28fbd1d957`) - ✅

⏲️ Total pipeline duration: 11mn49s

Step	Result
Build connector tar	✅
Build source-mysql-strict-encrypt docker image for platform(s) linux/x86_64	✅
Java Connector Unit Tests	✅
Java Connector Integration Tests	✅
Acceptance tests	✅
Validate metadata for source-mysql-strict-encrypt	✅
Connector version semver check	✅
Connector version increment check	✅
QA checks	✅

🔗 View the logs here

☁️ View runs for commit in Dagger Cloud

Please note that tests are only run on PR ready for review. Please set your PR to draft mode to not flood the CI engine and upstream service on following commits.
You can run the same pipeline locally on this branch with the airbyte-ci tool with the following command

airbyte-ci connectors --name=source-mysql-strict-encrypt test

airbyte-oss-build-runner · 2023-10-11T23:38:27Z

source-postgres-strict-encrypt test report (commit `28fbd1d957`) - ✅

⏲️ Total pipeline duration: 08mn03s

Step	Result
Build connector tar	✅
Build source-postgres-strict-encrypt docker image for platform(s) linux/x86_64	✅
Java Connector Unit Tests	✅
Java Connector Integration Tests	✅
Acceptance tests	✅
Validate metadata for source-postgres-strict-encrypt	✅
Connector version semver check	✅
QA checks	✅

🔗 View the logs here

☁️ View runs for commit in Dagger Cloud

Please note that tests are only run on PR ready for review. Please set your PR to draft mode to not flood the CI engine and upstream service on following commits.
You can run the same pipeline locally on this branch with the airbyte-ci tool with the following command

airbyte-ci connectors --name=source-postgres-strict-encrypt test

airbyte-oss-build-runner · 2023-10-12T00:06:04Z

source-mysql test report (commit `28fbd1d957`) - ✅

⏲️ Total pipeline duration: 27mn26s

Step	Result
Build connector tar	✅
Build source-mysql docker image for platform(s) linux/x86_64	✅
Java Connector Unit Tests	✅
Java Connector Integration Tests	✅
Acceptance tests	✅
Validate metadata for source-mysql	✅
Connector version semver check	✅
Connector version increment check	✅
QA checks	✅

🔗 View the logs here

☁️ View runs for commit in Dagger Cloud

Please note that tests are only run on PR ready for review. Please set your PR to draft mode to not flood the CI engine and upstream service on following commits.
You can run the same pipeline locally on this branch with the airbyte-ci tool with the following command

airbyte-ci connectors --name=source-mysql test

airbyte-oss-build-runner · 2023-10-12T00:33:04Z

source-postgres test report (commit `28fbd1d957`) - ❌

⏲️ Total pipeline duration: 26mn48s

Step	Result
Build connector tar	✅
Build source-postgres docker image for platform(s) linux/x86_64	✅
Java Connector Unit Tests	❌
Java Connector Integration Tests	✅
Acceptance tests	✅
Validate metadata for source-postgres	✅
Connector version semver check	✅
Connector version increment check	✅
QA checks	✅

🔗 View the logs here

☁️ View runs for commit in Dagger Cloud

Please note that tests are only run on PR ready for review. Please set your PR to draft mode to not flood the CI engine and upstream service on following commits.
You can run the same pipeline locally on this branch with the airbyte-ci tool with the following command

airbyte-ci connectors --name=source-postgres test

airbyte-oss-build-runner · 2023-10-12T04:11:00Z

source-mysql test report (commit `6f700deea9`) - ✅

⏲️ Total pipeline duration: 05mn23s

Step	Result
Build connector tar	✅
Build source-mysql docker image for platform(s) linux/x86_64	✅
Java Connector Unit Tests	✅
Java Connector Integration Tests	✅
Acceptance tests	✅
Validate metadata for source-mysql	✅
Connector version semver check	✅
Connector version increment check	✅
QA checks	✅

🔗 View the logs here

☁️ View runs for commit in Dagger Cloud

Please note that tests are only run on PR ready for review. Please set your PR to draft mode to not flood the CI engine and upstream service on following commits.
You can run the same pipeline locally on this branch with the airbyte-ci tool with the following command

airbyte-ci connectors --name=source-mysql test

airbyte-oss-build-runner · 2023-10-12T04:21:16Z

source-postgres-strict-encrypt test report (commit `6f700deea9`) - ✅

⏲️ Total pipeline duration: 10mn04s

Step	Result
Build connector tar	✅
Build source-postgres-strict-encrypt docker image for platform(s) linux/x86_64	✅
Java Connector Unit Tests	✅
Java Connector Integration Tests	✅
Acceptance tests	✅
Validate metadata for source-postgres-strict-encrypt	✅
Connector version semver check	✅
QA checks	✅

🔗 View the logs here

☁️ View runs for commit in Dagger Cloud

Please note that tests are only run on PR ready for review. Please set your PR to draft mode to not flood the CI engine and upstream service on following commits.
You can run the same pipeline locally on this branch with the airbyte-ci tool with the following command

airbyte-ci connectors --name=source-postgres-strict-encrypt test

airbyte-oss-build-runner · 2023-10-12T04:24:45Z

source-mysql-strict-encrypt test report (commit `6f700deea9`) - ✅

⏲️ Total pipeline duration: 03mn18s

Step	Result
Build connector tar	✅
Build source-mysql-strict-encrypt docker image for platform(s) linux/x86_64	✅
Java Connector Unit Tests	✅
Java Connector Integration Tests	✅
Acceptance tests	✅
Validate metadata for source-mysql-strict-encrypt	✅
Connector version semver check	✅
Connector version increment check	✅
QA checks	✅

🔗 View the logs here

☁️ View runs for commit in Dagger Cloud

Please note that tests are only run on PR ready for review. Please set your PR to draft mode to not flood the CI engine and upstream service on following commits.
You can run the same pipeline locally on this branch with the airbyte-ci tool with the following command

airbyte-ci connectors --name=source-mysql-strict-encrypt test

github-actions · 2023-10-12T04:27:21Z

Coverage report for source-postgres

There is no coverage information present for the Files changed

Total Project Coverage	71.72%	🍏

airbyte-oss-build-runner · 2023-10-12T04:50:56Z

source-postgres test report (commit `6f700deea9`) - ✅

⏲️ Total pipeline duration: 25mn59s

Step	Result
Build connector tar	✅
Build source-postgres docker image for platform(s) linux/x86_64	✅
Java Connector Unit Tests	✅
Java Connector Integration Tests	✅
Acceptance tests	✅
Validate metadata for source-postgres	✅
Connector version semver check	✅
Connector version increment check	✅
QA checks	✅

🔗 View the logs here

☁️ View runs for commit in Dagger Cloud

Please note that tests are only run on PR ready for review. Please set your PR to draft mode to not flood the CI engine and upstream service on following commits.
You can run the same pipeline locally on this branch with the airbyte-ci tool with the following command

airbyte-ci connectors --name=source-postgres test

bump cdk version for postgres, mysql sources

028466a

Rodi Reich Zilberman (rodireich) linked an issue Oct 11, 2023 that may be closed by this pull request

🐛 Large log message in java connectors can lead to loss of records #30781

Closed

Octavia Squidington III (octavia-squidington-iii) added area/connectors Connector related issues CDK Connector Development Kit connectors/source/mysql connectors/source/postgres connectors/source/mysql-strict-encrypt connectors/source/postgres-strict-encrypt labels Oct 11, 2023

update cdk README.md

b2be480

Rodi Reich Zilberman (rodireich) requested review from Aaron ("AJ") Steers (aaronsteers) and Duy Nguyen (nguyenaiden) October 11, 2023 22:23

Rodi Reich Zilberman (rodireich) marked this pull request as ready for review October 11, 2023 22:23

Rodi Reich Zilberman (rodireich) requested a review from a team as a code owner October 11, 2023 22:23

Akash Kulkarni (akashkulk) reviewed Oct 11, 2023

View reviewed changes

Rodi Reich Zilberman (rodireich) added 2 commits October 11, 2023 16:11

Merge branch 'master' into 30781-bump-cdk-ver

5da8299

bump mysql version

733137d

Octavia Squidington III (octavia-squidington-iii) added the area/documentation Improvements or additions to documentation label Oct 11, 2023

vercel Bot deployed to Preview October 11, 2023 23:14 View deployment

bump postgres version

28fbd1d

vercel Bot deployed to Preview October 11, 2023 23:17 View deployment

update cdk version test

6f700de

Prateek Mukhedkar (prateekmukhedkar) approved these changes Oct 12, 2023

View reviewed changes

Rodi Reich Zilberman (rodireich) merged commit 7e92375 into master Oct 12, 2023

Rodi Reich Zilberman (rodireich) deleted the 30781-bump-cdk-ver branch October 12, 2023 17:38

Aries Gunawan (ariesgun) pushed a commit to ariesgun/airbyte that referenced this pull request Oct 23, 2023

bump cdk version for postgres, mysql sources (airbytehq#31322)

d00fbd1

Conversation

Rodi Reich Zilberman (rodireich) commented Oct 11, 2023 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What

How

Uh oh!

vercel Bot commented Oct 11, 2023 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Oct 11, 2023

Before Merging a Connector Pull Request

Uh oh!

Rodi Reich Zilberman (rodireich) commented Oct 11, 2023 • edited by github-actions Bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Akash Kulkarni (akashkulk) Oct 11, 2023

Choose a reason for hiding this comment

Uh oh!

Rodi Reich Zilberman (rodireich) Oct 11, 2023

Choose a reason for hiding this comment

Uh oh!

Rodi Reich Zilberman (rodireich) commented Oct 11, 2023 • edited by github-actions Bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

airbyte-oss-build-runner commented Oct 11, 2023

source-mysql-strict-encrypt test report (commit 28fbd1d957) - ✅

Uh oh!

airbyte-oss-build-runner commented Oct 11, 2023

source-postgres-strict-encrypt test report (commit 28fbd1d957) - ✅

Uh oh!

airbyte-oss-build-runner commented Oct 12, 2023

source-mysql test report (commit 28fbd1d957) - ✅

Uh oh!

airbyte-oss-build-runner commented Oct 12, 2023

source-postgres test report (commit 28fbd1d957) - ❌

Uh oh!

airbyte-oss-build-runner commented Oct 12, 2023

source-mysql test report (commit 6f700deea9) - ✅

Uh oh!

airbyte-oss-build-runner commented Oct 12, 2023

source-postgres-strict-encrypt test report (commit 6f700deea9) - ✅

Uh oh!

airbyte-oss-build-runner commented Oct 12, 2023

source-mysql-strict-encrypt test report (commit 6f700deea9) - ✅

Uh oh!

github-actions Bot commented Oct 12, 2023

Coverage report for source-postgres

Uh oh!

airbyte-oss-build-runner commented Oct 12, 2023

source-postgres test report (commit 6f700deea9) - ✅

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

Rodi Reich Zilberman (rodireich) commented Oct 11, 2023 •

edited

Loading

vercel Bot commented Oct 11, 2023 •

edited

Loading

Rodi Reich Zilberman (rodireich) commented Oct 11, 2023 •

edited by github-actions Bot

Loading

Rodi Reich Zilberman (rodireich) commented Oct 11, 2023 •

edited by github-actions Bot

Loading

source-mysql-strict-encrypt test report (commit `28fbd1d957`) - ✅

source-postgres-strict-encrypt test report (commit `28fbd1d957`) - ✅

source-mysql test report (commit `28fbd1d957`) - ✅

source-postgres test report (commit `28fbd1d957`) - ❌

source-mysql test report (commit `6f700deea9`) - ✅

source-postgres-strict-encrypt test report (commit `6f700deea9`) - ✅

source-mysql-strict-encrypt test report (commit `6f700deea9`) - ✅

source-postgres test report (commit `6f700deea9`) - ✅