State Summary Lotus Task

[ZenGround0]

User Story

I want to know what composes the overall filecoin state overtime; I can go to a website that gives me an easy visualization (example) of the historical Filecoin state data breakdown summary, built from historical snapshot regularly.

Acceptance Criteria

Deliverables

Beta Give feedback

1. Lotus infra tasks include running the Filecoin snapshot state inspection job, on Sunday.
2. A website hosts the (historical) visualizations output from the snapshots summary task that viewers can inspect the state breakdowns like below.
3. A slack integration that posts a capture of the newly generated weekly visualization output & json breakdown. (we will include this in the sitrep)

Technical Breakdown

Tasks

Beta Give feedback

1. Cron file that runs the task weekly with the latest slide
2. A task script for running the snapshot state summary
3. Output from state summary is a timestamped json file on the main instance
4. A website serving the summary treemap graph off of the output json
5. Slack intergrtaion for postting the weekly output.

[jennijuju]

couple of questions for issue completion & effort estimation

• @snissn For deliverable 1: will we be resuing the infra setup in Lotus Network Check tooling #10981 to run this job too, or will we need to setup a new one?
• for the website serving the data, i would recommend we deploy to the same website used in State Invariant Checker Lotus Task #11023 as the 2nd subpage.
• Zen and I discussed that it would be nice to have a task running against the summary output, and send an alert if a state increased by X% in a week - @snissn @arajasek do you think it will be useful too?

[arajasek]

couple of questions for issue completion & effort estimation

• Zen and I discussed that it would be nice to have a task running against the summary output, and send an alert if a state increased by X% in a week - @snissn @arajasek do you think it will be useful too?

I'm neutral on this -- it doesn't seem too necessary to me, but I don't see any harm in having a well-calibrated alert. I would say "worth doing if it's less than 1 hour of work"?

[jennijuju]

@snissn can we add a quick % of each box size to the python script? (or on the side, a breakdown of size ranked by size %

[ZenGround0]

@snissn can we add a quick % of each box size to the python script? (or on the side, a breakdown of size ranked by size %

Note, I looked into doing this with the graphing library last week and had trouble finding a way to do this. However now that we have a webpage with multiple images we could always print the size values directly from the json in another image.

--edit--

Was looking into displaying percents on boxes not legend, looks like this parameter is promising: https://plotly.com/python/reference/treemap/#treemap-legend

[jennijuju]

just a nice-to-have: a sidebar menu for easily jumping on to the graph specific to a date (if its quick to do - or people can just ctrl-F the date