v1.82.0

[alextran1502]

v1.82.0

Warning

Action Required - BREAKING CHANGE

• The mobile app and server must be on the same version to work correctly.
• We removed a section from the default docker-compose.yml that passed the IMMICH_SERVER_URL and IMMICH_WEB_URL environment variables to immich-proxy. If your setup requires those, make sure you keep them passed through.
• We have improved the time bucket grouping algorithm (see more below). To take advantage of this feature, please run the job to “Extract Metadata” for all assets.
  

Security

We identified two security flaws that have been fixed and, therefore, urge all Immich users to upgrade as soon as possible.

• The first flaw link is of medium severity and could sometimes lead to information disclosure. This was reported to us by Andrea Alemani. Accessing the metadata of assets outside of the shared album was possible when using the shared album feature. This does not leak the entire photo/video content. Still, it includes the thumbhash (a very low-resolution placeholder) and information such as capture time, original filename, and file checksum.
• The other link is also an information disclosure classified as low severity. The signup process used a previously public endpoint (/api/user/count) to determine if the server had an initial administrator account. The endpoint revealed the number of user accounts on the Immich server, which is undesirable. We have added authentication to this endpoint and migrated the server initialization status to an alternative endpoint. This flaw was found by internal security testing (DAST) by the Immich team.

In addition, we have discovered that thumbnails (which can be downloaded from right-click -> save images as…) contain the full EXIF (metadata) information. Normally, you might expect this metadata to be scrubbed (as do Facebook, Google Photos, Twitter, etc.), but it isn’t. We are not able to fix it ourselves without significant performance degradation but have to wait for an upstream package. We advise users not to use the public-sharing feature if they have concerns about sharing metadata.

Highlights

Welcome to release v1.82.0 of Immich. This release is packed with many improvements, so buckle your seat belt and zoom on to the highlights below:

• Trash Feature
• Web Client WebSocket Feature
• Library Scanning Performance
• Time Bucket Grouping Accuracy
• Storage Template Improvements
• Notable fix: no longer read iOS-modified photos as “FullSizeRender” - Thanks, @xick, for fixing the issue upstream. You can fix the older assets by removing them from your immich server and reuploading the files, and they will have the original name.

Trash Feature

This release introduces the new trash feature, which is similar to the trash section on your native photo viewer. When a photo is deleted from Immich, it will go into the trash and stay there for 30 days before being permanently removed from Immich, which includes the database and the file system for non-external library assets. You can access the page from the sidebar on the web and the app drawer menu in the mobile app. Like with most features in Immich, you can adjust the trash duration or even opt out of the feature entirely from the Administration Settings. This has been a highly requested feature, and we hope you enjoy it. Let us know if you run into any issues using it.

Web Client WebSocket

Several actions in the web client previously required the user to manually refresh the page to see changes. In this release, we added a WebSocket connection to the web application, eliminating some of these manual refreshes and improving the user experience. Events that are now pushed from the server include:

• When a new feature photo is selected for a person
• When an asset is trashed, deleted, or restored
• When the server connects/disconnects
• When features are enabled/disabled (search, trash, map, machine learning, auth options, etc.)
• When server configuration is updated (trash days, map URL, OAuth button text)

With web sockets in place now both in the web and mobile apps, we hope to find additional ways to improve the user experience and push updates as they happen to appropriate clients.

Library Scanning Improvements

Library scanning performance has been significantly improved in this release. Specifically, the implementation for the initial scan has been greatly improved. Previously, this job had quadratic time complexity but has since been improved to linear time. On a library with 250k assets, the time to queue a library refresh has gone down from 10+ minutes (@etnoy said: I couldn’t be bothered to wait longer for a list comparison) to around 30 seconds.

Additionally, marking assets as offline has been improved as well. This process is used to execute a single query per asset, which adds up when large numbers of assets go offline. We have optimized this to use a single (bulk) update statement. For reference, marking 16k assets as offline went down from several minutes to a few seconds.

Lastly, we have added an index for asset lookups by path, which should decrease the amount of pressure on put on the database during library refreshes.

The default library job concurrency has been increased from 1 to 5.

These improvements will make it much easier to use Immich with large collections. Please let us know if you are still seeing performance bottlenecks in the library jobs. We plan to continue to iterate and improve this area in the future, and your feedback is very helpful in identifying issues.

Asset Time Buckets Grouping (web)

Assets are grouped by buckets on the web, and this was a problematic and complicated task when considering photos taken in different time zones. Even more so when considering a database, server, and client, which may all be running in different timezones, now, with a new database column localDateTime, we can query, sort, and group assets by the local date and time they were taken and show them consistently in the right bucket (in the correct order), regardless of the server or viewing timezone.

Storage Template Improvements

The storage template feature was added in the early days of Immich and has helped many people automatically organize the underlying files into a clean, predictable structure. However, the additional file move operations that were introduced with the feature have also been the cause of some nasty bugs, like #2877. In this release, we have hardened the move operations, which have significantly improved the resiliency of storage template move operations. Additionally, we have added a new page at Administration > Repair, which gives a report of orphaned and untracked files, with some initial tools to help correct previously orphaned files.

---

Please consider supporting the project.

Support

If you find the project helpful, you can support Immich via the following channels.

• Monthly donation via GitHub Sponsors
• One-time donation via GitHub Sponsors
• Librepay
• buymeacoffee
• Bitcoin: 1FvEp6P6NM8EZEkpGUFAN2LqJ1gxusNxZX

It is a great way to let me know that you want me to continue developing and working on this project for years to come.

Changelogs

Server

• feat(server): trash asset by @shalong-tanwen in feat(server): trash asset #4015
• feat(server): jpe extension by @jrasm91 in feat: jpe extension #4374
• feat(server): full backend end-to-end testing with microservices by @jrasm91 in test(server): full backend end-to-end testing with microservices #4225
• fix(server): use local time for time buckets and improve memories by @jrasm91 in fix: use local time for time buckets and improve memories #4072
• fix(server): use fileCreatedAt in bucket calculation by @etnoy in fix(server): use fileCreatedAt in bucket calculation #4354
• fix(server): dev compose by @jrasm91 in fix: dev compose #4357
• fix(server): migration efficiency by @jrasm91 in fix: migration efficiency #4359
• fix(server): time buckets by @jrasm91 in fix: time buckets #4358
• fix(server): normalize external path by @etnoy in fix(server): normalize external path #4239
• fix(server): delete library actually deletes (all) assets by @danieldietzler in fix(server): delete library actually deletes (all) assets #4386
• fix(server): make system config core singleton by @danieldietzler in fix(server): make system config core singleton #4392
• fix(server): clean up android motion assets by @jrasm91 in fix(server): clean up android motion assets #4393
• fix(server): timeline bucket access for shared links by @jrasm91 in fix(server): timeline bucket access for shared links #4404
• fix(server): add original path and library id index to asset by @etnoy in fix(server): add original path and library id index to asset #4410
• fix(server): only check external path once by @etnoy in fix(server): only check external path once #4419
• fix(server): schema generation by @jrasm91 in fix(server): schema generation #4424
• fix(server): improve library scan queuing performance by @etnoy in fix(server): improve library scan queuing performance #4418
• fix(server): don't publicly reveal user count by @etnoy in fix(server): don't publicly reveal user count #4409
• fix(server): include trashed asset during face re-index and cleanup by @shalong-tanwen in fix(server): include trashed asset during face re-index and cleanup #4450
• fix(server): don't float promises by @etnoy in fix(server,cli): don't float promises #4433
• fix(server): always show people with name, ignore count by @GenericGuy in fix(server): always show people with name, ignore count #4414
• fix(server): include trashed assets in existing assets list by @shalong-tanwen in fix(server): include trashed assets in existing assets list #4483
• fix(server): time buckets (again) by @jrasm91 in fix(server): time buckets (again) #4498
• fix(server): correctly remove metadata from shared links by @etnoy in fix(server,web): correctly remove metadata from shared links #4464
• refactor(server): filesystem crawl by @jrasm91 in refactor(server): filesystem crawl #4395
• refactor(server): domain repositories by @jrasm91 in refactor(server): domain repositories #4403
• refactor(server): make file movement more resilient by @danieldietzler in refactor(server): make file movement more resilient #4361
• refactor(server): library asset delete by @jrasm91 in refactor: library asset delete #4366
• chore(server): organize library imports by @jrasm91 in chore: organize library imports #4396
• chore(server): use force instead of forceRefresh by @jrasm91 in chore(server): use force instead of forceRefresh #4394

Machine Learning

• fix(ml): allow larger CLIP models by @mertalev in fix(ml): allow larger CLIP models #4422

Web

• feat(web): improve performances in person page (1) by @martabal in feat(server,web): improve performances in person page (1) #4387
• feat(web): offline/untracked files admin tool by @jrasm91 in feat(web,server): offline/untracked files admin tool #4447
• feat(web): enable WebSocket by @alextran1502 in feat(web): enable websocket #3765
• feat(web): ws - on_config_update by @shalong-tanwen in feat(web): ws - on_config_update #4378
• feat(web) add hover background to image toolbar icons by @katsadim in feat(web) add hover background to image toolbar icons #4402
• feat(web): show trash days info in trash page by @shalong-tanwen in feat(web): show trash days info in trash page #4484
• feat(web): save album sort direction/ sortDesc param by @JonasMayerDev in save album sort direction/ sortDesc param #4401
• fix(web): open external link in new tab by @daniele-athome in fix: open external link in new tab #4353
• fix(web): dev mode repeatedly optimizing dependencies by @mertalev in fix(web): dev mode repeatedly optimizing dependencies #4379
• fix(web): merge faces by @martabal in fix(web): merge faces #4383
• fix(web): people initialization on the merge face selector by @martabal in fix: people initialization on the merge face selector #4435
• fix(web): previous route when hiding a person by @martabal in fix(web): previous route when hiding a person #4452
• fix(web): empty placeholders by @jrasm91 in fix(web): empty placeholders #4470
• chore(web): move trash to alphabetical order by @jrasm91 in chore(web): move trash to alphabetical order #4462
• refactor(web): admin layout by @jrasm91 in refactor(web): admin layout #4461

Mobile

• feat(mobile): Offer the same album sorting options on mobile as on web by @agross in Offer the same album sorting options on mobile as on web #3804
• fix(mobile): remove upload soft limit by @shalong-tanwen in Fix/mobile remove upload soft limit #4380
• fix(mobile): asset state change not updated in gallery app bar by @shalong-tanwen in fix(mobile): asset state change not updated in gallery app bar #4441
• fix(mobile): description not render on first opening by @alextran1502 in fix(mobile): description not render on first opening #4451
• fix(mobile): reset trashed state for local assets on deletion by @shalong-tanwen in fix(mobile): reset trashed state for local assets on deletion #4501
• fix(mobile): handle asset trash, restore and delete ws events by @shalong-tanwen in fix(mobile): handle asset trash, restore and delete ws events #4482
• chore(mobile): update flutter build version by @alextran1502 in chore: update flutter build version #4429
• chore(mobile): pump photo_manager version by @alextran1502 in chore(mobile): pump photo_manager version #4412
• chore(mobile): video indicator by @shalong-tanwen in style(mobile): video indicator #4443

Others

• chore: bulk bump of dependencies with vulnerabilities by @debricked in chore(server,web,docs) bulk bump of dependencies with vulnerabilities #4312
• docs: Update nginx config docs by @wipfli in Update nginx config docs #4346
• docs: add troubleshooting info to libraries + minor docs tweaks by @etnoy in docs: add troubleshooting info to libraries + minor docs tweaks #4377
• docs: production build by @alextran1502 in fix(docs): production build #4431
• docs: immich title by @jrasm91 in docs: immich title #4463

New Contributors

• @wipfli made their first contribution in Update nginx config docs #4346
• @JonasMayerDev made their first contribution in save album sort direction/ sortDesc param #4401
• @debricked made their first contribution in chore(server,web,docs) bulk bump of dependencies with vulnerabilities #4312
• @katsadim made their first contribution in feat(web) add hover background to image toolbar icons #4402
• @agross made their first contribution in Offer the same album sorting options on mobile as on web #3804

Full Changelog: v1.81.1...v1.82.0

---

This discussion was created from the release v1.82.0.

[anultravioletaurora]

Brilliant work y’all 👏

[femto-code]

I agree - excellent work on this awesome project! Keep it up!

[sohail579]

Just a point on this

We removed a section from the default docker-compose.yml that passed the IMMICH_SERVER_URL and IMMICH_WEB_URL environment variables to immich-proxy. If your setup requires those, make sure you keep them passed through.

How do we know if we need it or not?

[D4koon]

Yes i have the same question, when i make a diff to the last version, it seems nearly identical?

Great work with this project!

[bo0tzz]

How do we know if we need it or not?

If you need it, you would know ;) It's only needed for unusual/non-default setups.

[jrasm91]

Also you can look in your .env file. If they don't exist there you do not need them

[sohail579]

ok i have broken it updated and i get this connect ECONNREFUSED 172.19.0.8:3001 please help

[sohail579]

scratch that its fixed itself and now working.. I commented out the environment section below hopefully its correct

immich-proxy:
container_name: immich_proxy
image: ghcr.io/immich-app/immich-proxy:${IMMICH_VERSION:-release}
#environment:
# Make sure these values get passed through from the env file
#- IMMICH_SERVER_URL
#- IMMICH_WEB_URL
ports:
- 2283:8080
depends_on:
- immich-server
- immich-web
restart: always

[EinToni]

Awesome work!

A quick question regarding the repair site. I now have a few untracked files that are orphaned in the upload folder. What shall I do with them? Just copy them out of there and reupload?

[jrasm91]

Yeah, but maybe check that they are complete files first, not just partial or incomplete uploads.

[EinToni]

Okay thank you, yeah good idea. 17/18 are broken and partially grey :c Well I guess I'll just delete them. Is the mobile app aware of the failed partial upload and automatically reuploads?

[jrasm91]

Yeah, should be. It'll be marked as "success" on the mobile app once it gets back an asset id, which doesn't happen unless the entire upload completes successfully.