Skip to content
This repository has been archived by the owner on Oct 31, 2023. It is now read-only.

Allow multiple nodes to compute same subtask. #50

Closed
badb opened this issue Nov 30, 2015 · 1 comment
Closed

Allow multiple nodes to compute same subtask. #50

badb opened this issue Nov 30, 2015 · 1 comment

Comments

@badb
Copy link
Contributor

badb commented Nov 30, 2015

Implement redundant verification from: https://github.com/golemfactory/golem-rd/wiki/Verification

First approach (abandoned branch) was here: https://github.com/golemfactory/golem/tree/redundant_computation

One potential approach is described below, but any other rational algorithm will be fine.

Algorithm proposal:
We define replication level x and consensus level c > x/2 and max tries m. Tasks send up to x copies of subtasks to different nodes and wait for the results. If c same answers is received the subtask is verified and all answers that are consistent with the consensus are accepted. If consensus is not reached within x subtasks, than additional m - x tasks may be send. If consensus is not reached subtask is marked as failed.
If consensus is reached before all x subtasks are send, then subtask is accepted.

Necessary changes:

  • subtask verification may be delayed
  • task should have num_subtask parameter
  • total_tasks = m * num_subtasks
  • task may be computed before total task number is reached
@badb badb added the planned label May 9, 2016
@badb badb self-assigned this May 9, 2016
@badb badb added this to the Clay milestone May 22, 2016
@badb badb added verification and removed planned labels May 22, 2016
@badb badb removed their assignment Dec 9, 2016
@badb badb added the planned label Apr 13, 2017
@badb badb removed the planned label Aug 14, 2017
@badb badb removed this from the Clay milestone Sep 28, 2017
@badb badb unassigned Krigpl May 28, 2018
@badb
Copy link
Contributor Author

badb commented May 18, 2020

It has been implemented for Usage Market and WASM.

@badb badb closed this as completed May 18, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

3 participants