Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to understand the capacity #112

Closed
walkerzhang opened this issue Mar 21, 2016 · 4 comments
Closed

How to understand the capacity #112

walkerzhang opened this issue Mar 21, 2016 · 4 comments

Comments

@walkerzhang
Copy link

I'm using the single node deployment and uploaded two files so far in different bucket.

1st file I uploaded is size 216.34KB. After uploaded, I checked the portal, used capacity is 84.54GB, so I think most of the size is system data.

2nd file is 2.1 GB. Later, the used capacity is 94GB. What I know there is no EC for single node deployment. So the incremental 10GB is triple of 2.1 GB plus more system data?

capacity

capacity

in dashboard it says 1.23 GB user data, but I have uploaded 2.1GB size file actually.

dashboard

What is this EC means here if no EC on single node?

ec

@padthaitofuhot
Copy link
Contributor

ECS uses a data boxcarting strategy called "chunking". Chunks are pre-allocated when ECS is first initialized. When user data is written into ECS, pre-allocated chunks are filled and ECS pre-allocates however many new chunks ECS "thinks" would be best for the future based on what it knows about the past.

Capacity statistics are calculated based on allocated and pre-allocated chunks at the time statistics are requested and don't exactly reflect the actual amount of user data stored within ECS. We do this because it is a performance-enhacing heuristic that is a "good enough" representation of capacities without having to churn through the whole system to figure out the actual user data capacity numbers. My apologies if it's a bit confusing at first, but I hope this explanation helps.

As for the Erasure Coding, stats showing... I don't know. I'll have to get back to you on that.

@padthaitofuhot
Copy link
Contributor

@twincitiesguy or @jasoncwik can either of you provide input on how ECS performs capacity reporting in 3.0?

@padthaitofuhot padthaitofuhot modified the milestones: Installer-2.0.0 for ECS 3.0.0, installer-2.1.0 for ECS 3.0.0 HF1 Apr 24, 2017
@padthaitofuhot padthaitofuhot added this to Triage in General Support Apr 24, 2017
@padthaitofuhot padthaitofuhot moved this from Triage to Needs Review in General Support Apr 24, 2017
@padthaitofuhot padthaitofuhot moved this from Triage to Needs Research in Documentation Herding Apr 24, 2017
@padthaitofuhot padthaitofuhot removed this from the installer 2.0.2 for ECS 3.0.0 HF1 milestone May 3, 2017
@padthaitofuhot padthaitofuhot added this to the Documentation Pass 1 milestone Jun 28, 2017
@ksteinfeldt ksteinfeldt moved this from Needs Research to In Process in Documentation Herding Jul 13, 2017
@ksteinfeldt ksteinfeldt moved this from In Process to Done in Documentation Herding Jul 14, 2017
@padthaitofuhot
Copy link
Contributor

@captntuttle Please link the associated documentation for this issue in a comment here. Thanks!

@ksteinfeldt
Copy link
Contributor

@padthaitofuhot padthaitofuhot moved this from Needs Review to Done in General Support Sep 22, 2017
@padthaitofuhot padthaitofuhot removed this from Done in General Support Sep 22, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

5 participants