Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pubsub Scoring (WIP) #700

Merged
merged 39 commits into from
Sep 8, 2022
Merged

Pubsub Scoring (WIP) #700

merged 39 commits into from
Sep 8, 2022

Conversation

amirylm
Copy link
Contributor

@amirylm amirylm commented Aug 31, 2022

Pubsub scoring capabilities based on ETH 2 config set (see code to generate) with some changes to adapt to the size and number of messages in our topics.

Note that scoring of message validation is not active at the moment, will be added with the validation epic.

Including the following changes:

  • added params package to manage all pubsub related params (scoring + thresholds and gossipsub)
  • added scoring params for decided and subnet topics
  • added tests to generate our params set based on different conditions
  • inject a function that calculates active validators in the network

TODO fine tune peer and topic scoring params to identify misbehaving peers

@amirylm amirylm force-pushed the scoring branch 4 times, most recently from 83b8201 to 73f409e Compare September 7, 2022 07:10
@amirylm amirylm marked this pull request as ready for review September 8, 2022 17:08
@amirylm amirylm changed the title Pubsub Scoring (Basic) Pubsub Scoring (WIP) Sep 8, 2022
@amirylm amirylm merged commit 85b3678 into stage Sep 8, 2022
amirylm added a commit that referenced this pull request Sep 15, 2022
* topic score params for decided and subnets (WIP)

* set coring flag to true by default

* fixes and score inspect logs

* add metric for scores

* align scoring params and log errors

* expose active validators for scoring params

* change peer identities reporting interval

* pubsub tracer: add reason in reject message

* refactor scoring params

aligned with https://gist.githubusercontent.com/blacktemplar/5c1862cb3f0e32a1a7fb0b25e79e6e2c/raw/1e9e322b21adcb657bea3596ea2deb19f319f707/generate-scoring-params.py
to have a more clean code strcuture and flexibility w.r.t checking and testing scoring params

* params package for managing pubsub params

* rename vars, clean scores metric every hour

* clean metrics
amirylm added a commit that referenced this pull request Sep 21, 2022
* topic score params for decided and subnets (WIP)

* set coring flag to true by default

* fixes and score inspect logs

* add metric for scores

* align scoring params and log errors

* expose active validators for scoring params

* change peer identities reporting interval

* pubsub tracer: add reason in reject message

* refactor scoring params

aligned with https://gist.githubusercontent.com/blacktemplar/5c1862cb3f0e32a1a7fb0b25e79e6e2c/raw/1e9e322b21adcb657bea3596ea2deb19f319f707/generate-scoring-params.py
to have a more clean code strcuture and flexibility w.r.t checking and testing scoring params

* params package for managing pubsub params

* rename vars, clean scores metric every hour

* clean metrics
@amirylm amirylm mentioned this pull request Sep 21, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant