Skip to content

Analyzer: Speed up scans#1179

Merged
d4rken merged 2 commits into
mainfrom
analyzer-delayed-app-loading
Jun 7, 2024
Merged

Analyzer: Speed up scans#1179
d4rken merged 2 commits into
mainfrom
analyzer-delayed-app-loading

Conversation

@d4rken

@d4rken d4rken commented May 24, 2024

Copy link
Copy Markdown
Member

Defer scanning apps in details until the user actually needs it. During the first pass of all apps, we only do a "shallow" scan, and then only if the enters the app details, then we do a deep scan.

The "shallow" scan uses the systems app storage stats as base information, actually scanning the files of each then only happens on demand.

This is a little less accurate, but a lot faster, and worth the trade off imho.

@d4rken d4rken added enhancement New feature, request, improvement or optimization c: StorageAnalyzer labels May 24, 2024
@d4rken

d4rken commented May 24, 2024

Copy link
Copy Markdown
Member Author

Closes #1098 as it will reduce memory overhead during the initial scan.
Closes #1122 as it will speed up the scan.

@d4rken d4rken marked this pull request as ready for review May 26, 2024 17:30
d4rken added 2 commits June 7, 2024 13:51
Defer scanning apps in details until the user actually needs it.
During the first pass of all apps, we only do a "shallow" scan, and then only if the enters the app details, then we do a deep scan.
Introduce new gateway method to just look op sizes like `du`.
More efficient than doing complete lookups that are then summed.
@d4rken d4rken force-pushed the analyzer-delayed-app-loading branch from e4e5704 to ded21c8 Compare June 7, 2024 12:46
@d4rken d4rken merged commit 948b8da into main Jun 7, 2024
@d4rken d4rken deleted the analyzer-delayed-app-loading branch June 7, 2024 13:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

c: StorageAnalyzer enhancement New feature, request, improvement or optimization

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant