face:background_job crashed by 8/8

[fr3ddy-sudo]

Hey, Thanks for reporting issues back to Nextcloud Face Recognition. Please, try to complete this report in detail so we can help you easier. 😄

Make sure you read all the documentation, and the FAQ, and that the issue has not been reported before. 😉

Expected behaviour

Backround_job runs normal

Actual behaviour

Backround_job crashed by 8/8

Steps to reproduce

sudo -u apache php /usr/share/nextcloud/occ face:background_job -t 900

Server configuration

• Operating system: Fedora 39

• Pdlib version: 1.1.0

• How is DLib installed: Make sure it is working correctly with this tool
  Test runs without Problems

• PHP version: 8.2.12

• Web server: apache

• Database: mariadb

• Nextcloud version: 27.1.3

Client configuration

• Browser: Chrome

• Operating system: Fedora 39

Logs

Background task log with debug.

sudo -u apache php occ -vvv face:background_job

 sudo -u apache php /usr/share/nextcloud/occ face:background_job  -vvv 
1/8 - Executing task CheckRequirementsTask (Check all requirements)
        System: Linux
        System memory: 32945115136
        PHP Memory Limit: 2147483648
        Clustering backend: pdlib
        Image Backend: Imagick
2/8 - Executing task CheckCronTask (Check that service is started from either cron or from command)
3/8 - Executing task DisabledUserRemovalTask (Purge all the information of a user when disable the analysis.)
yielding
4/8 - Executing task StaleImagesRemovalTask (Crawl for stale images (either missing in filesystem or under .nomedia) and remove them from DB)
        Skipping stale images removal for user fr3ddy as there is no need for it
5/8 - Executing task CreateClustersTask (Create new persons or update existing persons)
        Found 8 faces without associated persons for user fr3ddy and model 1
        Oldest face without persons for user fr3ddy and model 1 is from 2023-11-21 05:35:54
        Clusters already exist, estimated there is no need to recreate them
yielding
6/8 - Executing task AddMissingImagesTask (Crawl for missing images for each user and insert them in DB)
        Skipping full image scan for user fr3ddy
7/8 - Executing task EnumerateImagesMissingFacesTask (Find all images which don't have faces generated for them)
yielding
8/8 - Executing task ImageProcessingTask (Process all images to extract faces)
        NOTE: Starting face recognition. If you experience random crashes after this point, please look FAQ at https://github.com/matiasdelellis/facerecognition/wiki/FAQ

Web server error log

Web server error log

Insert your webserver log here

none

Nextcloud log (data/nextcloud.log)

Nextcloud log

Insert your Nextcloud log here

none

Browser log

none

[kuyper]

Hi, I might have a similar problem - it seems like nothing happens when I start the background job and I have lots of images that seemingly aren't analysed.

How can I find out what's happening? I don't find anything in nextcloud's logs and I have no idea how to get any error message out of the face recognition module itself.

I would very much like to find out what's going on.

My environment is nextcloud 27.1.5 in a docker image from the official images

[matiasdelellis]

Hi @fr3ddy-sudo

        Found 8 faces without associated persons for user fr3ddy and model 1
        Oldest face without persons for user fr3ddy and model 1 is from 2023-11-21 05:35:54
        Clusters already exist, estimated there is no need to recreate them

It found 8 new faces, but it says that it is not going to create clusters... that is because it tries not to recreate it continuously since it is a task that can consume important resources. The process simply has a two-hour window to recreate the clusters. After these two hours you will get the new faces/clusters.

ps.: sorry the delay.. I'm very busy.. 😞

[brccabral]

I am going through the same. I am using Nextcloud in a Docker. I was able to edit "apps/facerecognition/lib/BackgroundJob/Tasks/ImageProcessingTask.php" and added some log messages. In \ImageProcessingTask.execute() the value $images = $context->propertyBag['images']; is returning empty, even though I have uploaded many images.

I have another Nextcloud running directly on Ubuntu and Facerecognition runs fine. So, it is something related to the docker installation.

I used this method to create the docker instance https://github.com/juliushaertl/nextcloud-docker-dev

[brccabral]

I turns out in my case I didn't enable the user to "Analyze my images and group my loved ones with similar faces". Now it is working.

[fr3ddy-sudo]

Nothing changed by me Now NC29 on a Debian System

1/8 - Executing task CheckRequirementsTask (Check all requirements)
System: Linux
System memory: 67132043264
PHP Memory Limit: 4294967296
Clustering backend: pdlib
Image Backend: Imagick
2/8 - Executing task CheckCronTask (Check that service is started from either cron or from command)
3/8 - Executing task DisabledUserRemovalTask (Purge all the information of a user when disable the analysis.)
yielding
4/8 - Executing task StaleImagesRemovalTask (Crawl for stale images (either missing in filesystem or under .nomedia) and remove them from DB)
Skipping stale images removal for user fr3ddy as there is no need for it
5/8 - Executing task CreateClustersTask (Create new persons or update existing persons)
Found 0 faces without associated persons for user fr3ddy and model 1
Clusters already exist, estimated there is no need to recreate them
yielding
6/8 - Executing task AddMissingImagesTask (Crawl for missing images for each user and insert them in DB)
Skipping full image scan for user fr3ddy
7/8 - Executing task EnumerateImagesMissingFacesTask (Find all images which don't have faces generated for them)
yielding
8/8 - Executing task ImageProcessingTask (Process all images to extract faces)
NOTE: Starting face recognition. If you experience random crashes after this point, please look FAQ at https://github.com/matiasdelellis/facerecognition/wiki/FAQ

all Pictures until 07.04.24 are correct recognize.

all new pictures dont, and the code i used to force the recognize

sudo -u www-data /usr/bin/php --define apc.enable_cli=1 -f /var/www/nextcloud/occ face:background_job -t 900 --crawl-missing

The "--crawl-missing" option does not exist.

Dont work anymore

[fr3ddy-sudo]

Hi, your Information in
[https://github.com//discussions/716#discussioncomment-9204099]

solved my problem, with your bash script everything runs smooth thanks