Skip to content
This repository has been archived by the owner on Jul 16, 2021. It is now read-only.

Retryable Batches #1037

Closed
7 tasks done
gdbelvin opened this issue Sep 17, 2018 · 0 comments
Closed
7 tasks done

Retryable Batches #1037

gdbelvin opened this issue Sep 17, 2018 · 0 comments

Comments

@gdbelvin
Copy link
Contributor

gdbelvin commented Sep 17, 2018

The TrillianMap API needs to be retried in the event of any failure. TODO: add Trillian issue. This will greatly improve the reliability of the system and support recovery in the event of a failure.

There will be a series of small changes to support retryable batches:

  • Switching to a ReadQueue API
  • Read from Queue via min and max Timestamps
  • Deprecating the push based Receiver API for mutations
  • QueueMutation will write directly to a sharded, time ordered table.
  • CommitBatch will store high and low watermarks for a batch
  • ApplyBatch will read the mutation table at committed watermarks and apply the mutation function.
  • PublishBatch will write the SignedMapHead to the Log of MapHeads
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Projects
None yet
Development

No branches or pull requests

1 participant