Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BUG] Document import fails with Worker exited prematurely: signal 9 #3393

Closed
MarcelBochtler opened this issue May 14, 2023 · 5 comments
Closed

[BUG] Document import fails with Worker exited prematurely: signal 9 #3393

MarcelBochtler opened this issue May 14, 2023 · 5 comments
Labels
not a bug not a bug in paperless-ngx

Comments

@MarcelBochtler
Copy link
Contributor

Description

I'm trying to import this document into Paperless: https://download.brother.com/welcome/doc100913/cv_hll3210cw_ger_oug_b.pdf

The file import fails with the error pasted below.

Steps to reproduce

  1. Try to upload this document: https://download.brother.com/welcome/doc100913/cv_hll3210cw_ger_oug_b.pdf
  2. Paperless fails to store the document

Webserver logs

WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=9 f=-1(000) part=1
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=9 f=-1(000) part=1
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=29 f=-1(000) part=1
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=14 f=-1(000) part=1
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=17 f=-1(000) part=1
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=1 f=-1(000) part=1
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=9 f=-1(001) part=1
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=30 f=-1(001) part=1
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=24 f=-1(001) part=1
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=24 f=-1(001) part=1
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=1 f=-1(001) part=1
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=17 f=-1(001) part=1
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=15 f=-1(000) part=1
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=15 f=-1(000) part=1
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=3 f=-1(000) part=1
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=15 f=-1(000) part=1
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=3 f=-1(000) part=1
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=3 f=-1(000) part=1
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=22 f=-1(000) part=1
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=22 f=-1(000) part=1
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=2 f=-1(000) part=0
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=2 f=-1(000) part=0
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=2 f=-1(000) part=0
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=2 f=-1(000) part=1
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=6 f=-1(000) part=1
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=6 f=-1(000) part=1
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=18 f=-1(000) part=1
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=2 f=-1(000) part=1
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=2 f=-1(000) part=1
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=18 f=-1(000) part=1
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=20 f=-1(000) part=0
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=18 f=-1(000) part=1
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=20 f=-1(000) part=0
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=18 f=-1(000) part=1
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=20 f=-1(000) part=0
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=20 f=-1(000) part=1
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=21 f=-1(000) part=0
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=18 f=-1(000) part=1
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=20 f=-1(000) part=0
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=20 f=-1(000) part=1
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=18 f=-1(000) part=1
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=18 f=-1(000) part=1
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=21 f=-1(000) part=1
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=24 f=-1(000) part=1
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=12 f=-1(000) part=1
WARNING: decoder/databar.c:1248: _zbar_decode_databar: Assertion "seg->finder >= 0" failed.
        i=16 f=-1(000) part=1
[2023-05-14 15:18:50,147: ERROR/MainProcess] Process 'ForkPoolWorker-1' pid:412 exited with 'signal 9 (SIGKILL)'
[2023-05-14 15:18:50,206] [ERROR] [celery.worker.request] Task handler raised error: WorkerLostError('Worker exited prematurely: signal 9 (SIGKILL) Job: 0.')
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/billiard/pool.py", line 1265, in mark_as_worker_lost
    raise WorkerLostError(
billiard.exceptions.WorkerLostError: Worker exited prematurely: signal 9 (SIGKILL) Job: 0.

Browser logs

No response

Paperless-ngx version

1.14.4

Host OS

unRAID 6.11.5 behind an nginx reverse proxy

Installation method

Docker - official image

Browser

Firefox

Configuration changes

PAPERLESS_OCR_LANGUAGE, PAPERLESS_FILENAME_FORMAT, PAPERLESS_TIME_ZONE, URL, PAPERLESS_EMAIL_TASK_CRON, PAPERLESS_CONSUMER_ENABLE_ASN_BARCODE, PAPERLESS_CONSUMER_ASN_BARCODE_PREFIX

Other

No response
@MarcelBochtler MarcelBochtler added bug Bug report or a Bug-fix unconfirmed labels May 14, 2023
@shamoon shamoon added cant-reproduce not a bug not a bug in paperless-ngx and removed bug Bug report or a Bug-fix unconfirmed cant-reproduce labels May 14, 2023
@shamoon
Copy link
Member

shamoon commented May 14, 2023

This is a memory issue, I believe. Thats what the SIGKILL is. This is a large complex document with lots of images and youre scanning it for barcodes.

@MarcelBochtler
Copy link
Contributor Author

Yes, you're right my 16GB of memory fill quite soon after starting the import:

               total        used        free	  shared  buff/cache   available
Mem:            15Gi	   6.6Gi       171Mi	   1.6Gi       8.7Gi	   7.0Gi
Swap:             0B          0B          0B

Works perfectly fine when disabling barcode scanning:

PAPERLESS_CONSUMER_ENABLE_ASN_BARCODE=false

@stumpylog
Copy link
Member

You can also try using zxing instead of pyzbar, if you're on x86_64. It might be more efficient.

@MarcelBochtler
Copy link
Contributor Author

You can also try using zxing instead of pyzbar, if you're on x86_64. It might be more efficient.

Same issue using PAPERLESS_CONSUMER_BARCODE_SCANNER=ZXING.
The free memory (~ 7 GB) is consumed after a matter of seconds and I don't have any swap configured.

@github-actions
Copy link
Contributor

This issue has been automatically locked since there has not been any recent activity after it was closed. Please open a new discussion or issue for related concerns.

@github-actions github-actions bot locked as resolved and limited conversation to collaborators Jun 14, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
not a bug not a bug in paperless-ngx
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@stumpylog @MarcelBochtler @shamoon