Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Potential memory issue with attachments #195

Closed
doublehops opened this issue Sep 27, 2017 · 5 comments
Closed

Potential memory issue with attachments #195

doublehops opened this issue Sep 27, 2017 · 5 comments

Comments

@doublehops
Copy link

I seem to be running out of memory when the library downloads attachments greater than 500KB. How does the library handle memory? Is there a need or a way to clear the attachment from memory once a document has been saved locally? I'm not sure how to debug this issue at this time.

@Slamdunk Slamdunk added the bug label Sep 27, 2017
@Slamdunk Slamdunk added this to the 1.0 milestone Sep 27, 2017
@Slamdunk
Copy link
Collaborator

We'll try to reproduce the error as soon we finish the encoding refactor.
In the meantime, can you try to:

  1. Cycle through a bunch emails, sorted from smaller to larger, and output the memory consuption each step
  2. Post here the full error stack when it occurs

Please?

@doublehops
Copy link
Author

Thanks for the reply, I'll do this over the weekend. I should have mentioned that when the documents are saved to the hard disk, they are being converted to images (with convert) and having tesseract OCR the images. It could be any of these scripts that are causing memory issues but I'm trying to find the best way to isolate them and determine which is using the memory. Possibly htop will help me with this.

@Lewiscowles1986
Copy link

@doublehops I've backed up a few GB of emails with attachments varying from 5kb to 27MB (which is a stupid size of attachment). I've not noticed it blowing up RAM.

@Slamdunk Slamdunk removed this from the 1.0 milestone Sep 29, 2017
@doublehops
Copy link
Author

Thanks for the quick response and effort and thanks for creating the library.

@Slamdunk Slamdunk removed the bug label Oct 3, 2017
@Slamdunk
Copy link
Collaborator

Slamdunk commented Oct 3, 2017

No problem. For now I'm going to close the issue: if you ever face the problem again and you can provide an example, ping me

@Slamdunk Slamdunk closed this as completed Oct 3, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants