Skip to content

Conversation

stevensJourney
Copy link
Collaborator

Previously connector CRUD uploads were debounced on a trailing edge whenever a execute or writeTransaction method was called. Debouncing allows for larger batch operations to be executed inside the connector uploadCrud method.

The debouncing could cause large delays before the uploadCrud connector method is called if many writes are executed sequentially. This PR updates the debounced logic to a throttled method which will trigger the uploadCrud method periodically during such periods of writes.

The triggering of CRUD uploads has also been improved by watching for ps_crud table changes instead of running each time execute is called.

@stevensJourney stevensJourney marked this pull request as ready for review January 15, 2024 11:47
@stevensJourney stevensJourney merged commit 8298b84 into main Jan 15, 2024
@stevensJourney stevensJourney deleted the feature/better-crud-uploads branch January 15, 2024 11:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants