[BUG] bichon-cli OOMs on import

[mrskizzex]

Version

1.0.2

Steps to Reproduce

Try to import 4.7gb file to bichon.

Issue Description

bichon-cli tries to import the files, imports 100-150 emails and dies or locks up and then dies.

Screenshots or Logs (optional)

Processing file: 4705.0 MB
✔ Start importing? · yes
Starting import process...
  ✔ Sent 50 emails to [INBOX]
  ✔ Sent 50 emails to [INBOX]
  ✔ Sent 50 emails to [INBOX]
Killed

Processing file: 4705.0 MB
✔ Start importing? · yes
Starting import process...
  ✔ Sent 50 emails to [INBOX]
  ✔ Sent 50 emails to [INBOX]

Processing file: 4705.0 MB
✔ Start importing? · yes
Starting import process...
  ✔ Sent 50 emails to [INBOX]
  ✔ Sent 50 emails to [INBOX]

Starting import process...
  ✔ Sent 50 emails to [INBOX]
  ✔ Sent 50 emails to [INBOX]
  ✔ Sent 50 emails to [INBOX]
Killed

Starting import process...
  ✔ Sent 50 emails to [INBOX]
  ✔ Sent 50 emails to [INBOX]
  ✔ Sent 50 emails to [INBOX]
Killed

Starting import process...
  ✔ Sent 50 emails to [INBOX]
  ✔ Sent 50 emails to [INBOX]
  ✔ Sent 50 emails to [INBOX]
2026 May 18 08:31:25 truenas Process 609450 (gunicorn: worke) of user 1000 dumped core.

[rustmailer]

What is the memory limit of the service running bichon-cli?

[mrskizzex]

First I tried with 4gb limit on docker container, then i tried 8gb and both OOMed.

EDIT: I just tried with unlocked memory up to 32gb and it also died at around 5-6gb taken and 150 emails.

[mrskizzex]

Also it maybe a different issue but i'm not sure because it might be on my end after many times messing with those files, If I select Thunderbird import it doesn't find the local folders, it finds everything else except the blurred files which show up normally in Thunderbird.

The one that causes OOM is the 4.6GB one on the screenshot that i import manually as single mbox.

[rustmailer]

I suspect that a very large candidate file was loaded into memory by bichon-cli. The CLI does not validate the contents of each file before importing, and instead assumes that any candidate file is an mbox file. This will be fixed soon. For now, you can manually check for unrelated files, move them out of the directory, and then try the import again.

[rustmailer]

You could also use the less command or another tool to inspect the file and verify whether it is actually an mbox file.

[mrskizzex]

I was 100% sure they were valid mbox files as I can read them just fine in Thunderbird but I checked anyways.
I followed the OpenArchiver guide how to export mbox thunderbird local folders and as a result got these files:

It still fails even though I didn't limit the memory.

[rustmailer]

if there are particularly large individual emails in this mbox, like tens of MB? @mrskizzex

[mrskizzex]

144 emails from between 10mb to 71mb