New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
source-hubspot: migrate to base image #31644
source-hubspot: migrate to base image #31644
Conversation
The latest updates on your projects. Learn more about Vercel for Git ↗︎
|
Current dependencies on/for this PR:
This comment was auto-generated by Graphite. |
Before Merging a Connector Pull RequestWow! What a great pull request you have here! 🎉 To merge this PR, ensure the following has been done/considered for each connector added or updated:
If the checklist is complete, but the CI check is failing,
|
@@ -9,7 +9,6 @@ | |||
"airbyte-cdk", | |||
"backoff==1.11.1", | |||
"pendulum==2.1.2", | |||
"requests==2.26.0", |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
requests
is already an airbyte-cdk
transitive dependency.
Pinning it to an "old" 2.26.0 version leads to the following error when running spec
:
│ │ ┃ Traceback (most recent call last):
│ │ ┃ File "/airbyte/integration_code/main.py", line 8, in <module>
│ │ ┃ from airbyte_cdk.entrypoint import launch
│ │ ┃ File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/__init__.py", line 6, in <module>
│ │ ┃ from .entrypoint import AirbyteEntrypoint
│ │ ┃ File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 17, in <module>
│ │ ┃ import requests
│ │ ┃ File "/usr/local/lib/python3.9/site-packages/requests/__init__.py", line 100, in <module>
│ │ ┃ check_compatibility(urllib3.__version__, chardet_version, charset_normalizer_version)
│ │ ┃ File "/usr/local/lib/python3.9/site-packages/requests/__init__.py", line 85, in check_compatibility
│ │ ┃ raise Exception("You need either charset_normalizer or chardet installed")
│ │ ┃ Exception: You need either charset_normalizer or chardet installed
Remove requests
from setup.py
ensure the connector will use whatever version the CDK needs. The request's CDK version does not lead to this error when it's built inside or python base image.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I'm going to fix this here: #31606
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@alafanechere final CI checks for this one #31606 and we're good to go. I've also cleared the |
@alafanechere It's merged. |
e603948
to
78bdcb0
Compare
source-hubspot test report (commit
|
Step | Result |
---|---|
Build source-hubspot docker image for platform(s) linux/x86_64 | ✅ |
Unit tests | ✅ |
Integration tests | ✅ |
Acceptance tests | ✅ |
Code format checks | ✅ |
Validate metadata for source-hubspot | ✅ |
Connector version semver check | ✅ |
QA checks | ❌ |
☁️ View runs for commit in Dagger Cloud
Please note that tests are only run on PR ready for review. Please set your PR to draft mode to not flood the CI engine and upstream service on following commits.
You can run the same pipeline locally on this branch with the airbyte-ci tool with the following command
airbyte-ci connectors --name=source-hubspot test
78bdcb0
to
fd1a479
Compare
source-hubspot test report (commit
|
Step | Result |
---|---|
Build source-hubspot docker image for platform(s) linux/x86_64 | ✅ |
Unit tests | ✅ |
Integration tests | ✅ |
Acceptance tests | ✅ |
Check our base image is used | ✅ |
Code format checks | ✅ |
Validate metadata for source-hubspot | ✅ |
Connector version semver check | ✅ |
Connector version increment check | ✅ |
QA checks | ✅ |
☁️ View runs for commit in Dagger Cloud
Please note that tests are only run on PR ready for review. Please set your PR to draft mode to not flood the CI engine and upstream service on following commits.
You can run the same pipeline locally on this branch with the airbyte-ci tool with the following command
airbyte-ci connectors --name=source-hubspot test
What
Migrating
source-hubspot
myself as I noticed thebuild
fails when using our new base image.How
airbyte-ci connectors --name=source-hubspot migrate_to_base_image 31644
I fixed the build by removing the
requests
explicit dependency. This connector will getrequests
from the CDK deps.We have to wait for #31606 to be mainlined to fix CAT run