Nextcloud 28: face recognition + clustering work, but no results in Web interface

[nbluemer]

Expected behaviour

Face recognition should work: after activation and successful completion of background jobs, clusters should show up in Settings/Personal/Face recognition as shown on https://github.com/matiasdelellis/facerecognition/wiki/Usage (and in tabs in file and photo apps).

Actual behaviour

The actual face recognition and clustering seem to work perfectly fine (see logs below).

However, in the web interface, no faces are shown. Instead, in Settings/Personal/Face recognition a message shows up: "Your friends have not been recognized yet".

I assume that this is an incompatibility with Nextcloud 28 (which I unfortunately ended up with).

Steps to reproduce

1. Installation of Nextcloud on a fresh VPS server with https://github.com/nextcloud/vm/blob/master/nextcloud_install_production.sh (which took at least an hour; in retrospect, I should have used the argument --not-latest).
2. Installation of pdlib and face recognition following https://technik.xn--schchner-2za.de/blog/2023/08/08/pdlib-installieren/ and method 1 in https://technik.xn--schchner-2za.de/blog/2023/08/08/face-recognition-gesichtserkennung-in-nextcloud/
3. Added line 'allow_local_remote_servers' => true, in /var/www/nextcloud/config/config.php (in order to get rid of error message regarding Imaginary in background job)

Server configuration

• Operating system:
  Ubuntu 22.04

• Pdlib version:
  1.0.2

• How is DLib installed: Make sure it is working correctly with this tool
  see above. Test works.

• How is PDlib installed: Make sure it is working correctly with this tool
  see above. Test works.

• PHP version:
  8.1.2

• Web server:
  Apache 2.4.52

• Database:
  postgreSQL 14.10

• Nextcloud version:
  28.0.1.1

Client configuration

• Browser:
  Chrome + Safari

• Operating system:
  Mac OS 13.6.3

Logs

Background task log with debug.

root@nc:/var/www/nextcloud# sudo -u www-data php /var/www/nextcloud/occ face:stats
+----------+--------+-------+----------+---------+
| User     | Images | Faces | Clusters | Persons |
+----------+--------+-------+----------+---------+
| admin-NB | 15     | 4     | 0        | 0       |
+----------+--------+-------+----------+---------+
root@nc:/var/www/nextcloud# sudo -u www-data php -f /var/www/nextcloud/occ face:background_job -t 900
1/8 - Executing task CheckRequirementsTask (Check all requirements)
2/8 - Executing task CheckCronTask (Check that service is started from either cron or from command)
3/8 - Executing task DisabledUserRemovalTask (Purge all the information of a user when disable the analysis.)
4/8 - Executing task StaleImagesRemovalTask (Crawl for stale images (either missing in filesystem or under .nomedia) and remove them from DB)
5/8 - Executing task CreateClustersTask (Create new persons or update existing persons)
	Face clustering will be created for the first time.
	4 faces found for clustering
	1 clusters found after clustering
6/8 - Executing task AddMissingImagesTask (Crawl for missing images for each user and insert them in DB)
7/8 - Executing task EnumerateImagesMissingFacesTask (Find all images which don't have faces generated for them)
8/8 - Executing task ImageProcessingTask (Process all images to extract faces)
	NOTE: Starting face recognition. If you experience random crashes after this point, please look FAQ at https://github.com/matiasdelellis/facerecognition/wiki/FAQ

Question

Is there any simple way to see the results of face recognition via the command line?

Remark

I have donated $10 via Paypal (although I am just starting with Nextcloud, i.e. could not yet use face recognition).

[matiasdelellis]

Hi @nbluemer

Face recognition should work: after activation and successful completion of background jobs, clusters should show up in Settings/Personal/Face recognition as shown on https://github.com/matiasdelellis/facerecognition/wiki/Usage (and in tabs in file and photo apps).

I have to fix some small changes, but the app seems to be compatible. Just updated an Nc28 😄

+----------+--------+-------+----------+---------+
| User     | Images | Faces | Clusters | Persons |
+----------+--------+-------+----------+---------+
| admin-NB | 15     | 4     | 0        | 0       |
+----------+--------+-------+----------+---------+

From this table I can see that you only uploaded 15 images and this resulted in only 4 faces detected.. This is very little.

	4 faces found for clustering
	1 clusters found after clustering

Here you can see that of these 4 faces only one cluster could be made (This is the relationship of two similar faces). You could find these 4 faces on the side bars. But it will not show it to you in memories (the application that I recommend to you today.), because it only shows clusters with more than 5 faces

So, please add more images and check the side bar.

I have donated $10 via Paypal (although I am just starting with Nextcloud, i.e. could not yet use face recognition).

Wow.. Thanks a lot! ❤️

[stefan230561]

I have the same thing as @nbluemer. After the update to Nextcloud 28 faces are recognized but not displayed in the Memories web interface.
Luckily I had a backup and restored it and I'm now back on Nextcloud 27

[florealcab]

Is there a fix scheduled soon for this to be able to upgrade my nextcloud instance?

[Dark-Noir]

I got a similar issue but with NC 27.1.7, i can't find any persons/people in the webui:

+-------------------+--------+-------+----------+---------+
| User              | Images | Faces | Clusters | Persons |
+-------------------+--------+-------+----------+---------+
| Darkestnoir_Admin | 15     | 23    | 14       | 0       |
+-------------------+--------+-------+----------+---------+

[florealcab]

Is this project still alive? No update since 3 monthes...

[matiasdelellis]

Is this project still alive? No update since 3 monthes...

Yes, but my man work has nothing related to this or nextcloud.

About this particular report, you should increase the number of images. With 15 photos you will simply find enough faces to do the processing.

[matiasdelellis]

I close this report. You simply have to do a more realistic test, but reducing the "Minimun faces in cluster" option to 1 you should see the images.