feat(server): optimize partial facial recognition

[mertalev]

Description

Based on the discussion here, this PR changes facial recognition queuing:

• Face detection will not queue facial recognition if no faces are detected
• Only detected faces are queued, not all missing faces
• A nightly job is added to do more thorough recognition
• Manually running "missing" still does the more thorough recognition

Specifically, this is the new behavior for clustering:

• If the face is a core face (i.e. there are min faces - 1 faces around it) and a person exists for it, clustering works as normal
• If the face is a core face and there's no similar face with a person, a person is created, but the other faces aren't clustered unless they're in the same batch of new faces
• If the face is a non-core face and there's a similar face with a person, clustering works as normal
• If the face is a non-core face and there's no similar face with a person, then it won't be clustered

There is an edge case where this change can lead to a duplicate person: if a new person is created in the partial clustering and the faces similar to it existed before this batch of faces, then only the core face that created the person will be assigned this person until the nightly job runs. This means that if another image containing a face of this person is uploaded before the nightly job, then it will only be clustered if it can reach the face that created the person, not just any face of that person. If it can't and the face is a core face, a new person will be created.

Implementation notes:

• The queue facial recognition job is added before adding the individual recognition jobs as a gatekeeper to prevent the jobs from running until all queued detection jobs are finished
• The recognition jobs are queued within the detection handler instead of in onDone to support the more nuanced queueing
• Bulk upload should work the same, just with a different queueing method

How Has This Been Tested?

Tested with debug logging to check that it queues the faces from Face Detection, not all missing faces.

[mertalev]

No clue why those mobile tests are failing

[cloudflare-pages]

Deploying with    Cloudflare Pages

Latest commit:	aef9d2e
Status:	✅  Deploy successful!
Preview URL:	https://c8ec1a81.immich.pages.dev
Branch Preview URL:	https://feat-optimize-partial-facial.immich.pages.dev

View logs