Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Wakurtosis retro #131

Open
wants to merge 21 commits into
base: develop
Choose a base branch
from
Open

Wakurtosis retro #131

wants to merge 21 commits into from

Conversation

Daimakaimura
Copy link

@Daimakaimura Daimakaimura commented Sep 27, 2023

TL;DR

The Wakurtosis framework aimed to simulate and test the behaviour of the Waku protocol at large scales but faced a plethora of challenges that ultimately led us to pivot to a hybrid approach that relies on Shadow and Kubernetes for greater reliability, flexibility, and scaling. Here we will discuss some of the most important issues we faced and their potential solutions in a new hybrid framework.

Copy link

@AlbertoSoutullo AlbertoSoutullo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@kaiserd
Copy link
Contributor

kaiserd commented Oct 17, 2023

sembr 🙏

@kaiserd
Copy link
Contributor

kaiserd commented Oct 22, 2023

Could you please apply sembr to this post @Daimakaimura

@Daimakaimura Daimakaimura marked this pull request as ready for review October 23, 2023 13:14
@Daimakaimura
Copy link
Author

@0xFugue could you please have a look too?

Copy link
Contributor

@kaiserd kaiserd left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for this post :).
My comments are in-line.

The main issue, imo, is confusion around hardware problems seemingly being connected to Kurtosis,
but the only connection is Kurtosis not allowing a multi-machine setup.

You could set-up a red thread through the post by explaining that our simulations need high hardware requirements, and, because of this, Kurtosis only being able to run on a single machine does not allow us to scale simulations. That should also be part of the abstract.

rlog/2023-09-26-wakurtosis-retro.mdx Outdated Show resolved Hide resolved
rlog/2023-09-26-wakurtosis-retro.mdx Outdated Show resolved Hide resolved
rlog/2023-09-26-wakurtosis-retro.mdx Outdated Show resolved Hide resolved
rlog/2023-09-26-wakurtosis-retro.mdx Outdated Show resolved Hide resolved
rlog/2023-09-26-wakurtosis-retro.mdx Outdated Show resolved Hide resolved
rlog/2023-09-26-wakurtosis-retro.mdx Outdated Show resolved Hide resolved
rlog/2023-09-26-wakurtosis-retro.mdx Outdated Show resolved Hide resolved
rlog/2023-09-26-wakurtosis-retro.mdx Show resolved Hide resolved
rlog/2023-09-26-wakurtosis-retro.mdx Show resolved Hide resolved
rlog/2023-09-26-wakurtosis-retro.mdx Outdated Show resolved Hide resolved
@kaiserd
Copy link
Contributor

kaiserd commented Oct 31, 2023

@AlbertoSoutullo could please also check my comments, and check if you have some input 🙏

@Daimakaimura
Copy link
Author

Thanks for the review @kaiserd

Daimakaimura and others added 12 commits November 1, 2023 07:49
Co-authored-by: kaiserd <1684595+kaiserd@users.noreply.github.com>
Co-authored-by: kaiserd <1684595+kaiserd@users.noreply.github.com>
Co-authored-by: kaiserd <1684595+kaiserd@users.noreply.github.com>
Co-authored-by: kaiserd <1684595+kaiserd@users.noreply.github.com>
Co-authored-by: kaiserd <1684595+kaiserd@users.noreply.github.com>
Co-authored-by: kaiserd <1684595+kaiserd@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants