Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Datasource Statistics may not scale properly on larger systems #4500

Closed
TheWitness opened this issue Dec 10, 2021 · 0 comments
Closed

Datasource Statistics may not scale properly on larger systems #4500

TheWitness opened this issue Dec 10, 2021 · 0 comments
Assignees
@TheWitness
Labels
bug Undesired behaviour data collection Issues related to data collection resolved A fixed issue
Milestone
v1.2.20

Comments

@TheWitness
Copy link
Member

Describe the bug

On large systems with excess of 1M Data Sources, DSStats can not keep up, and will crash those systems.

Expected behavior

DSStats should be able to scale to larger systems without issue as it provides key information for dashboard development.
@TheWitness TheWitness added the bug Undesired behaviour label Dec 10, 2021
@TheWitness TheWitness added this to the v1.2.20 milestone Dec 10, 2021
@TheWitness TheWitness self-assigned this Dec 10, 2021
TheWitness added a commit that referenced this issue Dec 10, 2021
@TheWitness
Fixing Issues #4495 and #4500 DSStats Issues
9f27a24 
* DSStats Does not Scale on Large Systems
* DSStats will get invalid data for some devices after reboot requiring purging of stats

This is way less than what I want to do, but these are all essentially bugs.

There is also a change to lib/boost.php to provide better debug logging when testing.
@TheWitness TheWitness mentioned this issue Dec 10, 2021
Closed
@TheWitness TheWitness added resolved A fixed issue data collection Issues related to data collection labels Dec 10, 2021
TheWitness added a commit that referenced this issue Dec 21, 2021
@TheWitness
Fixing Issue #4509 - Slow Template Editing
af4911f 
* Graph Templating is quite slow on very large systems
* Update ChangLog for #4500 and #4495 as well
@netniV netniV changed the title DSStats Does not Scale on Large Systems Datasource Statistics may not scale properly on larger systems Apr 3, 2022
@github-actions github-actions bot locked and limited conversation to collaborators Dec 2, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@TheWitness TheWitness

Labels
bug Undesired behaviour data collection Issues related to data collection resolved A fixed issue
Projects
None yet
Milestone
v1.2.20
Development

No branches or pull requests
1 participant
@TheWitness