Skip to content

Removes concurrency support temporarily to see if backfills complete with 100% accuracy#377

Merged
stevenwarren-stripe merged 1 commit into
mainfrom
stevenwarren/reduce-parallelism
May 15, 2026
Merged

Removes concurrency support temporarily to see if backfills complete with 100% accuracy#377
stevenwarren-stripe merged 1 commit into
mainfrom
stevenwarren/reduce-parallelism

Conversation

@stevenwarren-stripe
Copy link
Copy Markdown

Summary

There could be a race condition when backfilling using the data bisect that is causing chunks of rows to not be processed and dropped silently.

This PR reduces the concurrency to 1 for each collection so that we process in series instead of parallel to mitigate the possibility of a race condition between fetches.

How to test (optional)

Related

  • Closes #

Thanks for contributing ❤️

@stevenwarren-stripe stevenwarren-stripe merged commit 4fe54e6 into main May 15, 2026
18 of 19 checks passed
@stevenwarren-stripe stevenwarren-stripe deleted the stevenwarren/reduce-parallelism branch May 15, 2026 18:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants