New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
source-postgres : Bump DBZ default time to 1200 sec #32961
Conversation
The latest updates on your projects. Learn more about Vercel for Git ↗︎
|
Before Merging a Connector Pull RequestWow! What a great pull request you have here! 🎉 To merge this PR, ensure the following has been done/considered for each connector added or updated:
If the checklist is complete, but the CI check is failing,
|
Coverage report for source-postgres
|
@@ -265,7 +265,7 @@ | |||
"type": "integer", | |||
"title": "Initial Waiting Time in Seconds (Advanced)", | |||
"description": "The amount of time the connector will wait when it launches to determine if there is new data to sync or not. Defaults to 300 seconds. Valid range: 120 seconds to 1200 seconds. Read about <a href=\"https://docs.airbyte.com/integrations/sources/postgres#step-5-optional-set-up-initial-waiting-time\">initial waiting time</a>.", |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Update the description, it says it defaults to 300 seconds. Also, consider raising the upper bound of the valid range, perhaps?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Good catch - done!
We've seen that DBZ times out fairly frequently, since it takes some time for heartbeat events to be emitted.
For many OC issues, bumping up the timeout from 5 min -> 20 min has helped. In this PR, we do it by default. For the happy case, this will NOT affect speed of sync, since this time is reset when we receive the first record.
Part of effort detailed in #32946