Skip to content
This repository has been archived by the owner on Oct 17, 2022. It is now read-only.

Assume batches can be stored on workers with ids other than the author's #54

Closed
akichidis opened this issue Feb 15, 2022 · 2 comments
Closed
Projects

Comments

@akichidis
Copy link
Contributor

On the current implementation when a worker forms a new batch it broadcasts it to the worker nodes of the same id of other validators. That assumption is propagated across the codebase - meaning that irrespective of which primary node we query, we assume that a specific batch will be found to the worker of same id (which is basically dictated by the propagated header)

The above assumption is making scaling quite restrictive and eventually we want it removed. On our network our primary node should keep the mapping it self to which local worker a batch has been stored and basically decouple the storying/query semantics from the ones that the author produces (worker id). It has to be noted that a batch is identified by two parameters: the batch digest and the worker_id (author). We still want to be able to identify batches based on both those two properties, but for our primary node we should be able to translate that to which local worker the batch has been stored.

@github-actions
Copy link

This issue is stale because it has been open 60 days with no activity. Remove stale label or comment or this will be closed in 7 days.

@github-actions github-actions bot added the Stale label Aug 17, 2022
@akichidis
Copy link
Contributor Author

Closing in favour of the work already designed & started here #670

@akichidis akichidis closed this as not planned Won't fix, can't repro, duplicate, stale Aug 17, 2022
@huitseeker huitseeker removed the Stale label Aug 22, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
No open projects
Stage 1
Awaiting triage
Development

No branches or pull requests

2 participants