Reth node archive snapshots with 8KB MDBX page size

[dalechyn]

We run two archive Base mainnet nodes, both of which have /db/mdbx.dat at 4.5TB size.

Before September 15, reth's default allowed database size was 4TB, but was bumped to 8TB paradigmxyz/reth@5844ff7, /db/mdbx.dat at that time weighted a little less than 4TB.

With the current increasing block gas limit, transactions on Base mainnet, we expect the database to grow faster with time.

Unfortunately, 8TB is the max possible DB size, because of the default page size for database being 4KB.
Trying to overwrite --db.max-size to 16TB would result in an error (paradigmxyz/reth#19234 (comment)).

Last month, increasing such became possible (paradigmxyz/reth#19546), but in order to make it happen the page size has to be bumped to the next power of 2 - to 8KB.
Quote:

it's not possible to change the page size without re-creating the database, effectively meaning a resync of the node.

Meaning that we need at least 8KB page size DB and therefore reth snapshots to be uploaded to (https://docs.base.org/base-chain/node-operators/snapshots), to be able to expand max db size to 16TB, which would have ~28% of space occupied at the time of opening this ticket.

Currently, 56% of DB is occupied.

Considering the slow speed of full resync, I believe this should be revised ASAP to let the reth node maintainers to prepare the migration.

[mur-me]

Bump this, good point about the nearest future headache

[danyalprout]

That's for raising. The Reth team is working on DB changes that will mitigate this.

Once they are released we'll push a new snapshot with them included.

[dalechyn]

That's for raising. The Reth team is working on DB changes that will mitigate this.

Once they are released we'll push a new snapshot with them included.

Can you please link a PR/issue where they mitigate this? Would be useful for everyone to track it.

[dalechyn]

That's for raising. The Reth team is working on DB changes that will mitigate this.

Once they are released we'll push a new snapshot with them included.

Friendly bump, checked reth repo and could not find any tracking issue/PR.

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[mur-me]

One more friendly bump

[blocknodehub]

+1

[blocknodehub]

How's the progress?

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[mur-me]

As per today DB size is 5.39TB which is 67.38% from 8 TB.

Ony 219 days left at current db population speed: