chore: Add misc/stress-test

[jefft0]

This PR adds a Go utility in misc/stress-test/stress-test-many-posts which adds millions of posts to the (local) boards realm to test how memory and transaction time change with lots of realm storage. See the README for how to use it. See this report for example graphs created from using this utility.

[thehowl]

Great stuff!

[jefft0]

Interim results with gnoland

Here are some results with gnoland (on-disk storage) where the max allowed gas was increased for adding 500 posts each transaction. The stress test added a million posts.

On average, it took 5 seconds to add 500 posts. This remained fairly constant. (I was testing this on my working Mac. The extra time during 600 000 and 700 000 was because my browser was temporarily using a lot of memory. This wouldn't happen on a dedicated node.) Here is the gnoland memory usage:

It uses a baseline 330 MB RAM for zero posts and 418 MB RAM for one million posts, with fairly linear increase. That's 88 bytes per post, which is much more reasonable than 20 000 bytes per post for in-memory storage. When gnodev supports on-disk storage, we'll repeat this experiment using it.

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 54.63%. Comparing base (900bb2f) to head (d7338dd).

Additional details and impacted files

@@           Coverage Diff           @@
##           master    #1583   +/-   ##
=======================================
  Coverage   54.63%   54.63%           
=======================================
  Files         583      583           
  Lines       78507    78507           
=======================================
  Hits        42895    42895           
  Misses      32399    32399           
  Partials     3213     3213           

Flag	Coverage Δ
misc/autocounterd	0.00% <ø> (ø)
misc/genproto	0.00% <ø> (ø)
misc/genstd	73.90% <ø> (ø)
misc/goscan	0.00% <ø> (ø)
misc/logos	17.68% <ø> (ø)
misc/loop	0.00% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[thehowl]

@jefft0 what's the status on this PR? Do you need feedback or directions of how to move forward?

[jefft0]

@jefft0 what's the status on this PR? Do you need feedback or directions of how to move forward?

I'm still settling on the best way to run the tests. Right now it uses a clone of r/demo/boards running on a local gnoland. The clone is needed to fix this problem.

Also, it's necessary to rebuild gnoland with a hack to increase the MaxGas so that more operations can be done per transaction to stuff data into the node. Otherwise it takes forever. Can MaxGas be configured on the command line to start gnoland? (It has -genesis-max-vm-cycles but this doesn't prevent the "invalid gas" error.)

Should this PR be merged if it needs hacks like this to get it running?

[thehowl]

(It has -genesis-max-vm-cycles but this doesn't prevent the "invalid gas" error.)

It currently doesn't do anything, because NewApp in gno.land/pkg/gnoland/app.go doesn't have cfg.MaxCycles = maxCycles. (lol).

I'm making a PR to fix that, but I wanted to add the unused-param linter to avoid this happening again, and I'm now in a rabbit hole. In any case, thought I'd mention this here so you can at least sort it out with a patch on your side. (Or use gnodev, which shouldn't have this issue)

Should this PR be merged if it needs hacks like this to get it running?

No, fair point. Let's wait on the outstanding issues. It may also be nice, for this PR specifically, to add instructions in a README on how to run the stress test. Let's re-consider how to add this after fixing max-vm-cycles and the GetOrigCaller issue.

[jefft0]

Hi @thehowl . Thanks to the merging of #2358, this utility doesn't need hacks to run. I added a README and changed from Draft to Read to Review.