New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
🎉 Destination redshift: reenable T+D optimizations; bigquery+snowflake: bump to latest CDK version #33704
Conversation
The latest updates on your projects. Learn more about Vercel for Git ↗︎
|
Before Merging a Connector Pull RequestWow! What a great pull request you have here! 🎉 To merge this PR, ensure the following has been done/considered for each connector added or updated:
If the checklist is complete, but the CI check is failing,
|
// Decrement by 1 second since timestamp precision varies between databases. | ||
final Optional<Instant> ts = minUnloadedTimestamp | ||
.map(Timestamp::toInstant) | ||
.map(i -> i.minus(1, ChronoUnit.SECONDS)); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
this is slightly different from the original redshift implementation - instead of doing a timestamp subtraction within redshift, we just query the raw timestamp and decrement it in java code. Timestamp math can be dialect-specific, so probably not a good idea to have it in a base Jdbc implementation.
airbyte-integrations/connectors/destination-snowflake/build.gradle
Outdated
Show resolved
Hide resolved
/publish-java-cdk
|
Warning 🚨 Connector code freeze is in effect until 2024-01-02. This PR is changing connector code. Please contact the current OC engineers if you want to merge this change to master. |
/approve-and-merge reason="shipping one last redshift beta update; all tests passing" |
…e: bump to latest CDK version (airbytehq#33704)
…e: bump to latest CDK version (airbytehq#33704)
…e: bump to latest CDK version (airbytehq#33704)
closes #33685
snowflake+bigquery technically aren't affected by this (the only CDK code change is in the JdbcDestinationHandler, which neither of them rely on) but figured I might as well trigger their test suites.