Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Short-term data storage improvements #9054

Closed
4 tasks done
Tracked by #9091
, #41
...
thanethomson opened this issue Jul 20, 2022 · 5 comments
Closed
4 tasks done
Tracked by #9091
, #41
...

Short-term data storage improvements #9054

thanethomson opened this issue Jul 20, 2022 · 5 comments
Assignees
@samricotta
Labels
maintenance Bug/security fixes, correctness, reliability, performance and general QA

Comments

@thanethomson
Copy link
Contributor

thanethomson commented Jul 20, 2022 •
edited

Tracking issue for 2022 Q3 work on storage optimization.
@thanethomson thanethomson added priority T:tracking Tracking issue for other issues maintenance Bug/security fixes, correctness, reliability, performance and general QA labels Jul 20, 2022
@tac0turtle
Copy link
Contributor

Is this a tracking issue for abci responses or storage improvements in general? I think there are a few more things people could add in for storage improvements

@thanethomson
Copy link
Contributor Author

It's purely all work related to the Council's Q3 priorities. The issue's still a WIP.

@thanethomson thanethomson changed the title Data storage improvements WIP: Data storage improvements Jul 20, 2022
@thanethomson thanethomson changed the title WIP: Data storage improvements WIP: Short-term data storage improvements Jul 23, 2022
@cmwaters cmwaters mentioned this issue Jul 25, 2022
Merged
@thanethomson thanethomson mentioned this issue Jul 25, 2022
Closed
39 tasks
@thanethomson thanethomson added priority A high-priority, high-level item to be shown on the priorities project board and removed T:tracking Tracking issue for other issues labels Jul 27, 2022
@thanethomson thanethomson changed the title WIP: Short-term data storage improvements Short-term data storage improvements Jul 28, 2022
@cmwaters
Copy link
Contributor

We ran two osmosis nodes. One with a modified binary that used the v0.34.x branch (which discards ABCI responses and only stores the last for crash recovery purposes) and the other that used v0.34.19. After about 18 hours of usage from a quick sync snapshot here is the disk usage:

Regular Node

1.9G	./data/state.db
1.1G	./data/blockstore.db

Modified Node

176M	./data/state.db
1.1G	./data/blockstore.db

cc: @ValarDragon

@ValarDragon
Copy link
Contributor

Amazing!! Thanks for making this happen!

@thanethomson
Copy link
Contributor Author

Seems like we can mark this as done now.

@thanethomson thanethomson removed the priority A high-priority, high-level item to be shown on the priorities project board label Dec 22, 2022
@thanethomson thanethomson mentioned this issue Dec 23, 2022
Closed
38 tasks
@rach-id rach-id mentioned this issue Oct 25, 2023
Merged
5 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@samricotta samricotta

Labels
maintenance Bug/security fixes, correctness, reliability, performance and general QA
Projects
Tendermint
Status: Done/Merged
Milestone
No milestone
Development

No branches or pull requests
5 participants
@thanethomson @ValarDragon @tac0turtle @cmwaters @samricotta