Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Check the pool used space from the bytes used in the storage pool stats collector, for non-default primary storage pools that cannot provide stats. #5586

Merged
merged 3 commits into from Oct 25, 2021

Conversation

sureshanaparti
Copy link
Contributor

@sureshanaparti sureshanaparti commented Oct 19, 2021

Description

This PR checks the pool used space from the bytes used in the storage pool stats collector, for non-default primary storage pools that cannot provide stats. It also update the used bytes from the pool stats answer for non-default primary storage pools if the pool can provide stats.

The PR #4360 updates the used bytes in the database for default primary storage pools only through the stats collector, and computes storage pool space usage from that database value instead of in-memory stats (from the stats collector). So, the storage pool space for non-default primary storage pools is computed against the used bytes in the database which is not updated from the stats collector, and computing with in-memory stats is also removed. This PR keeps the pool used space computation as before (using the in-memory stats from the stats collector), for the non-default primary storage pools.

Types of changes

  • Breaking change (fix or feature that would cause existing functionality to change)
  • New feature (non-breaking change which adds functionality)
  • Bug fix (non-breaking change which fixes an issue)
  • Enhancement (improves an existing feature and functionality)
  • Cleanup (Code refactoring and cleanup, that may add test cases)

Feature/Enhancement Scale or Bug Severity

Feature/Enhancement Scale

  • Major
  • Minor

Bug Severity

  • BLOCKER
  • Critical
  • Major
  • Minor
  • Trivial

Screenshots (if appropriate):

How Has This Been Tested?

Manually tested using PowerFlex/ScaleIO storage.

…ts collector, for non-default primary storage pools that cannot provide stats.

Also, Update the used bytes from the pool stats answer for non-default primary storage pools if the pool can provide stats.
@sureshanaparti
Copy link
Contributor Author

@blueorangutan package

1 similar comment
@sureshanaparti
Copy link
Contributor Author

@blueorangutan package

@blueorangutan
Copy link

Packaging result: ✔️ el7 ✔️ el8 ✔️ debian ✔️ suse15. SL-JID 1593

@sureshanaparti
Copy link
Contributor Author

@blueorangutan test matrix

@blueorangutan
Copy link

@sureshanaparti a Trillian-Jenkins matrix job (centos7 mgmt + xs71, centos7 mgmt + vmware65, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

@blueorangutan
Copy link

Trillian test result (tid-2450)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 29195 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr5586-t2450-kvm-centos7.zip
Intermittent failure detected: /marvin/tests/smoke/test_internal_lb.py

@blueorangutan
Copy link

Trillian test result (tid-2449)
Environment: xenserver-71 (x2), Advanced Networking with Mgmt server 7
Total time taken: 29272 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr5586-t2449-xenserver-71.zip
Intermittent failure detected: /marvin/tests/smoke/test_internal_lb.py

rohityadavcloud and others added 2 commits October 21, 2021 12:45
Co-authored-by: Daniel Augusto Veronezi Salvador <38945620+GutoVeronezi@users.noreply.github.com>
@Override
public boolean canPoolProvideStorageStats(StoragePool pool) {
DataStoreProvider storeProvider = _dataStoreProviderMgr.getDataStoreProvider(pool.getStorageProviderName());
DataStoreDriver storeDriver = storeProvider.getDataStoreDriver();
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@sureshanaparti do we need to do any defensive/null checks?

@rohityadavcloud
Copy link
Member

@blueorangutan package

@blueorangutan
Copy link

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan
Copy link

Packaging result: ✔️ el7 ✔️ el8 ✔️ debian ✔️ suse15. SL-JID 1599

@rohityadavcloud
Copy link
Member

@blueorangutan test

@blueorangutan
Copy link

@rhtyd a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

@rohityadavcloud
Copy link
Member

@blueorangutan package

@blueorangutan
Copy link

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan
Copy link

Packaging result: ✔️ el7 ✔️ el8 ✔️ debian ✔️ suse15. SL-JID 1602

@nvazquez
Copy link
Contributor

@blueorangutan test

@blueorangutan
Copy link

@nvazquez a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

@blueorangutan
Copy link

Trillian test result (tid-2459)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 32524 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr5586-t2459-kvm-centos7.zip
Smoke tests completed. 91 look OK, 0 have errors
Only failed tests results shown below:

Test Result Time (s) Test File

@rohityadavcloud
Copy link
Member

Ping @borisstoyanov @vladimirpetrov are you lgtm on it?

Copy link
Contributor

@vladimirpetrov vladimirpetrov left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM based on manual testing with PowerFlex storage.

image

image

@nvazquez nvazquez merged commit 0a88e71 into apache:main Oct 25, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

7 participants