Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Exclude zookeeper dependencies #37584

Merged
merged 12 commits into from
Apr 26, 2024
Merged

Exclude zookeeper dependencies #37584

merged 12 commits into from
Apr 26, 2024

Conversation

evantahler
Copy link
Contributor

@evantahler evantahler commented Apr 25, 2024

Partially closes https://github.com/airbytehq/airbyte-internal-issues/issues/7245. We don't need zookeeper. This PR will need to bump the CDK and then connectors will have to update the version of the CDK they use. That is blocked by upgrading destinations to the latest Kotlin CDK, e.g. #36899

Copy link

vercel bot commented Apr 25, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Ignored Deployment
Name Status Preview Comments Updated (UTC)
airbyte-docs ⬜️ Ignored (Inspect) Visit Preview Apr 26, 2024 8:14pm

@evantahler evantahler marked this pull request as ready for review April 26, 2024 15:53
@evantahler evantahler requested review from a team as code owners April 26, 2024 15:53
@octavia-squidington-iii octavia-squidington-iii added the area/documentation Improvements or additions to documentation label Apr 26, 2024
@evantahler
Copy link
Contributor Author

The only test failure is a timeout 🤷

@evantahler evantahler changed the title Exclude zookeeper Exclude zookeeper dependencies Apr 26, 2024
@stephane-airbyte
Copy link
Contributor

@evantahler you can use the @timeout annotation on the failing test to give it more time. That being said, I have seen several tests failing here and there with a 1minute timeout, but it should be set to 5 minutes by default... Might be worth investigation what's going on with that

@edgao
Copy link
Contributor

edgao commented Apr 26, 2024

@stephane-airbyte where are we setting the 5 minute default? This line is setting 1 minute

junitMethodExecutionTimeout = '1 m'

(... I also have this PR #37494, where I set 5m for bigquery 9f95b29

@stephane-airbyte
Copy link
Contributor

thank you for keeping me honest @edgao . So default Timeout is one minute. The current timeout is odd because it seems to be "caused" by an image not found error from docker, which makes very little sense. 1) why would finding a docker image take over a minute and 2) why would it trigger a timeout rather than a proper ImageNotFoundException ??? I'm just going to re-run those tests for now

Copy link
Contributor

@postamar postamar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Kill it with fire. These m/r dependencies are just ridiculous but that's nothing new.

@@ -1 +1 @@
version=0.30.11
version=0.31.0
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why the minor version bump?

Also please update the CDK changelog.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I picked a minor bump because this removed a lot of transitive dependencies. I'm a little worried that something deep down was relying on on them, but I can't be sure (the tests pass... so yolo?)

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

changelog bumped

@evantahler
Copy link
Contributor Author

Tests are passing - moving forward with the new CDK version and deploy

@evantahler
Copy link
Contributor Author

evantahler commented Apr 26, 2024

/publish-java-cdk

🕑 https://github.com/airbytehq/airbyte/actions/runs/8853711534
✅ Successfully published Java CDK version=0.31.0!

@evantahler evantahler enabled auto-merge (squash) April 26, 2024 20:26
@evantahler evantahler merged commit e8859b2 into master Apr 26, 2024
34 checks passed
@evantahler evantahler deleted the evan/zookeeper++ branch April 26, 2024 20:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/connectors Connector related issues area/documentation Improvements or additions to documentation CDK Connector Development Kit connectors/destination/bigquery
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants