Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Intermediate flush to disk #10

Open
edermi opened this issue Sep 7, 2018 · 1 comment
Open

Intermediate flush to disk #10

edermi opened this issue Sep 7, 2018 · 1 comment

Comments

@edermi
Copy link

edermi commented Sep 7, 2018

First of all thanks for the nice project. Would it be possible to implement some regular "disk flushes"? I tried to dump a slightly large AD today and - even with the -m option enabled - easily exhausted the 12GB RAM in my VM. Writing information to disk and clearing internal data structures from time to time will probably drastically reduce the memory consumption.

@dirkjanm
Copy link
Owner

dirkjanm commented Sep 8, 2018

This is kind of a known issue that is still on my to-do but requires a lot of changes. Reason for this is that all the (recursive) group memberships are calculated in-memory so all data has to be loaded first before the structured files can be written to disk. I do have some ideas to make this more efficient but this requires restructuring a major part of the code, which I don't have the time for currently.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants