Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore: improving node setup w.r.t sharding information #2187

Merged
merged 1 commit into from
Nov 21, 2023

Conversation

SionoiS
Copy link
Contributor

@SionoiS SionoiS commented Nov 6, 2023

Description

Various misc. fixes and changes related to shards, Waku metadata and testings.

Motivated by #2151 which made me realized testing was not ergonomic w.r.t. sharding.

Changes

  • added shards info to Waku metadata protocol setup
  • refactor Discv5 setup
  • added check for cluster id mismatch between config and ENR
  • change default topic for tests to shard 0 in cluster 2
  • added param to tests nodes allowing extra shards
  • tests nodes ENRs are now updated with sharding info

Close #2183

@SionoiS SionoiS changed the title refactoring stuff chore: improving node setup w.r.t sharding information Nov 6, 2023
@SionoiS SionoiS self-assigned this Nov 6, 2023
@SionoiS SionoiS added the E:1.4: Sharded peer management and discovery See https://github.com/waku-org/pm/issues/67 for details label Nov 6, 2023
Copy link

github-actions bot commented Nov 6, 2023

You can find the image built from this PR at

quay.io/wakuorg/nwaku-pr:2187

Built from 626b852

@SionoiS SionoiS force-pushed the chore--refactor-shard-flow branch 3 times, most recently from e3c6974 to b0aaa70 Compare November 9, 2023 14:37
@SionoiS SionoiS marked this pull request as ready for review November 9, 2023 15:16
apps/wakunode2/app.nim Outdated Show resolved Hide resolved
@gabrielmer gabrielmer self-requested a review November 10, 2023 14:13
Copy link
Contributor

@gabrielmer gabrielmer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! Thank you :)

@SionoiS SionoiS requested review from jm-clius and removed request for Ivansete-status November 14, 2023 12:15
@SionoiS SionoiS force-pushed the chore--refactor-shard-flow branch 2 times, most recently from de8062e to 74aa3f8 Compare November 15, 2023 14:11
Copy link
Contributor

@jm-clius jm-clius left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks reasonable to me. :)

waku/waku_metadata/protocol.nim Outdated Show resolved Hide resolved
apps/wakunode2/app.nim Show resolved Hide resolved
@SionoiS SionoiS force-pushed the chore--refactor-shard-flow branch 3 times, most recently from ff4c433 to 8d7b521 Compare November 17, 2023 13:26
@SionoiS
Copy link
Contributor Author

SionoiS commented Nov 17, 2023

I don't get it! All test green locally but it always fail here......

@SionoiS SionoiS force-pushed the chore--refactor-shard-flow branch 2 times, most recently from dc5efd2 to 416757d Compare November 21, 2023 16:43
@SionoiS
Copy link
Contributor Author

SionoiS commented Nov 21, 2023

Seams like the bug is fixed. Merging even with JS failing as it's not related.

@SionoiS SionoiS merged commit 897f487 into master Nov 21, 2023
9 of 10 checks passed
@SionoiS SionoiS deleted the chore--refactor-shard-flow branch November 21, 2023 20:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
E:1.4: Sharded peer management and discovery See https://github.com/waku-org/pm/issues/67 for details
Projects
None yet
Development

Successfully merging this pull request may close these issues.

chore: improve cluster id, shards, topics flow
4 participants