New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Destination Bigquery - Remove v2 check #31717
Conversation
The latest updates on your projects. Learn more about Vercel for Git ↗︎
|
Before Merging a Connector Pull RequestWow! What a great pull request you have here! 🎉 To merge this PR, ensure the following has been done/considered for each connector added or updated:
If the checklist is complete, but the CI check is failing,
|
@@ -373,23 +373,20 @@ private SerializedAirbyteMessageConsumer getStandardRecordConsumer(final BigQuer | |||
return new BigQueryRecordStandardConsumer( | |||
outputRecordCollector, | |||
() -> { | |||
final boolean use1s1t = TypingAndDedupingFlag.isDestinationV2(); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Is it worth deleting the whole isDestinationV2
method to avoid this kind of accidental resurrection of legacy logic ?. I only see only this 1 usage in IDE, not sure if i can trust that.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Good thought - I am gonna punt on that for now since we're still moving more destinations to the v2 format, so I have a feeling we will using again very shortly for redshift, clickhouse, etc.
destination-bigquery test report (commit
|
Step | Result |
---|---|
Build connector tar | ✅ |
Java Connector Unit Tests | ✅ |
Build destination-bigquery docker image for platform(s) linux/amd64 | ✅ |
Java Connector Integration Tests | ❌ |
Validate metadata for destination-bigquery | ✅ |
Connector version semver check | ✅ |
Connector version increment check | ❌ |
QA checks | ✅ |
☁️ View runs for commit in Dagger Cloud
Please note that tests are only run on PR ready for review. Please set your PR to draft mode to not flood the CI engine and upstream service on following commits.
You can run the same pipeline locally on this branch with the airbyte-ci tool with the following command
airbyte-ci connectors --name=destination-bigquery test
destination-bigquery test report (commit
|
Step | Result |
---|---|
Build connector tar | ✅ |
Java Connector Unit Tests | ✅ |
Build destination-bigquery docker image for platform(s) linux/amd64 | ✅ |
Java Connector Integration Tests | ✅ |
Validate metadata for destination-bigquery | ✅ |
Connector version semver check | ✅ |
Connector version increment check | ✅ |
QA checks | ✅ |
☁️ View runs for commit in Dagger Cloud
Please note that tests are only run on PR ready for review. Please set your PR to draft mode to not flood the CI engine and upstream service on following commits.
You can run the same pipeline locally on this branch with the airbyte-ci tool with the following command
airbyte-ci connectors --name=destination-bigquery test
A previous pr inadvertently added back an "is destination v2" check which has been removed from the config and would always resolve false, causing the raw tables to not be created