Skip to content

Correct eqxsync progress management, rebasing on Equinox.Projection pipeline#21

Merged
bartelink merged 8 commits intomasterfrom
cosmos-sync-progress
May 7, 2019
Merged

Correct eqxsync progress management, rebasing on Equinox.Projection pipeline#21
bartelink merged 8 commits intomasterfrom
cosmos-sync-progress

Conversation

@bartelink
Copy link
Copy Markdown
Collaborator

This takes work carried out as part of #16 (which yielded an optimized projection pipeline which lives in the Equinox.Projection NuGet as of 2.0.0-preview6) and feeds it into the dotnet new eqxsync template, with the following effects:

  • Corrects progress management (the CFP doesnt impede progress or retry if projection is failing)
  • Enhances throughput by decoupling feed reading / lease management (the CFP bit), progress writing (managed async by CosmosIngester), ingestion (via CosmosIngester, which uses Equinox.Projection.Scheduling to manage the processing async)

(Pending testing and load testing, but pretty much code complete at present)

@bartelink bartelink merged commit e980f8e into master May 7, 2019
@bartelink bartelink deleted the cosmos-sync-progress branch May 7, 2019 14:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant