v1.95.0 #7252
Replies: 22 comments 65 replies
-
|
I am getting the error below when trying to update pgVectors as outlined in the release notes without superuser permissions for Immich - any advice? |
Beta Was this translation helpful? Give feedback.
-
|
@danieldietzler My discord is `` do you mind reaching out? I am having some issues where it seems Immich didn't run the REINDEX commands, but when I run |
Beta Was this translation helpful? Give feedback.
-
|
You can just join the official Immich discord :) (e.g. linked on the website or in the GitHub readme) |
Beta Was this translation helpful? Give feedback.
-
|
That apparently doesn't work @danieldietzler or at least didn't a few weeks ago. I finally found a random invite on Reddit that did work |
Beta Was this translation helpful? Give feedback.
-
|
Hm that's weird. For me the link on github works. |
Beta Was this translation helpful? Give feedback.
-
|
@mertalev Here are some additional instructions for non-superuser roles. Likely this will be the case for people with standalone PG installs.
Steps:
Restart your database and then run A healthy Vectors migration running as the user |
Beta Was this translation helpful? Give feedback.
-
|
Great release. My immich was broken after vectors was added since I use an external postgres. This release everything is working again! |
Beta Was this translation helpful? Give feedback.
-
|
Very happy to be able to search for media not in any album! |
Beta Was this translation helpful? Give feedback.
-
|
Just upgraded and played around a little. Great work, well done! The search feature is working like a charm! |
Beta Was this translation helpful? Give feedback.
-
|
Holy sh*t. New Search functionality is awesome and pretty fast. I love how detailed the release notes are. Keep up the work!! |
Beta Was this translation helpful? Give feedback.
-
|
Agreed! That is stupid fast and something that's been holding me back from fully migrating to Immich, the search was terrible. This is awesome!!! |
Beta Was this translation helpful? Give feedback.
-
|
Do you happen to know how to search on the filename? Thanks! |
Beta Was this translation helpful? Give feedback.
-
|
Thanks for the release, having 2 issues here after the upgrade
In the docker-compose file I've only changed the image Any hints where to search? |
Beta Was this translation helpful? Give feedback.
-
|
For the library watch issue, start here. Fix that first, as that could be the cause of the Postgres connection reset possibly. |
Beta Was this translation helpful? Give feedback.
-
|
@mmomjian thank you very much, fixed the library watch issue now it works again |
Beta Was this translation helpful? Give feedback.
-
|
A friendly reminder to take a new backup of the database with the new version, from my testing restoring a database from previous versions does not work with the new version, producing errors like: A side solution to this would be if the version of your database is 1.94.1 it is necessary to return to this version (it is necessary to change the file docker-compose.yml according to version 1.94.1) to restore the database and then upgrade to the new version together with the data restored from the database . This will trigger the merge process along with the data from the restored database. |
Beta Was this translation helpful? Give feedback.
-
|
Woop Woop - many thanks :) |
Beta Was this translation helpful? Give feedback.
-
|
One little thing I noticed I have some pictures where people appear multiple times (photo of a photo strip from photo booths or picture in a mirror that results in multiple face detections). If I search for multiple people I always get results from these pictures, even if only of them is in the picture. I think further improvements for the search feature could be sort people alphabetically and have a "or" functionality instead of "and". The context search also seems to be disabled currently for people search, not sure exactly why. |
Beta Was this translation helpful? Give feedback.
-
|
E.g. like this one |
Beta Was this translation helpful? Give feedback.
-
|
infinite face glitch because of mirror :D cc: @martabal
Technical limitation |
Beta Was this translation helpful? Give feedback.
-
|
Thanks for the reply. Another way to tackle this would probably be to limit the number of face matches per picture to 1 |
Beta Was this translation helpful? Give feedback.
-
|
When this feature should be extended to have a filtered album based on search I think the or people filter would be great. E.g. Share an album with my family members with any of them appearing in it |
Beta Was this translation helpful? Give feedback.
-
Beta Was this translation helpful? Give feedback.
-
|
I am using the recommended docker-compose file. Therefore I guess that immich should have superuser permissions in the database. (Docker runs in rootless mode, but this should not affect the superuser permissions - i guess) I executed the commands manually as I receive the following error messages: |
Beta Was this translation helpful? Give feedback.
-
|
@webzit I think your Postgres instance was actually already using 0.2.0 before you ran those manual commands. The UPDATE pg_catalog.pg_extension SET extversion = '0.2.0' WHERE extname = 'vectors'; |
Beta Was this translation helpful? Give feedback.
-
|
Thank you very much. Actually, I guess I misread the first error message and that's why I executed the commands. Now everything is working again. Thank you very much! |
Beta Was this translation helpful? Give feedback.
-
|
Ah, I see, should have restarted postgres, I missed that step. all good. |
Beta Was this translation helpful? Give feedback.
-
|
That fixed everything for me. Thanks a lot! |
Beta Was this translation helpful? Give feedback.
-
|
Not going to pretend to understand everything that is happening in this update, but looks good! |
Beta Was this translation helpful? Give feedback.
-
|
I only changed But it works. |
Beta Was this translation helpful? Give feedback.
-
|
I guess step 2 could be ignored if you don't use Authentik
|
Beta Was this translation helpful? Give feedback.
-
|
Ditto, didn't receive any errors either. @alextran1502 Is this intended behavior? |
Beta Was this translation helpful? Give feedback.
-
|
@AndyPro720 I saw a few reports cases that don't see this message, and it is fine. |
Beta Was this translation helpful? Give feedback.
-
|
People search is awesome! Is it planned to search albums as it was before? I miss that functionality, currently having more than 300 albums. |
Beta Was this translation helpful? Give feedback.
-
|
yeah that would make sense to continue build upon this |
Beta Was this translation helpful? Give feedback.
-
|
[v1.95.0] and [v1.95.1] I noticed that you can't use UP/DOWN and PgUp/PgDn. Home/End keys in the browser. |
Beta Was this translation helpful? Give feedback.
-
|
it's always been like this since the viewport has a custom scroll technique for fast scrubbing and optimized performance, not a normal scrolling view. |
Beta Was this translation helpful? Give feedback.
-
|
oh, i see. Luckily auto-scroll works :) |
Beta Was this translation helpful? Give feedback.
-
|
After the migration, I'm getting the following error every time I try to view any photo:
I'm using external postgres server with manually installed pg vectors, so I probably messed up something. Does anyone have any idea what that error message might indicate? |
Beta Was this translation helpful? Give feedback.
-
|
I'm confused about the schema issue - your output of This is mine: |
Beta Was this translation helpful? Give feedback.
-
|
Ah, that happens because I did ran the create schema command without being connected to my immichdb. Do all the migration commands assume I'm connected to the immich database? If that's the case, then maybe it might explain the issues I'm having. (That being said, I did run the create schema command while connected to my immich database, but that alone didn't fix the actual issue. However, the \dn+ command now matches to yours above.) |
Beta Was this translation helpful? Give feedback.
-
|
I believe they have to be run in the Immich DB, yes. Maybe you will have to re run those steps, and then you can see my other post above to |
Beta Was this translation helpful? Give feedback.
-
|
Yep, that was the culprint! Thank you for all your time and comments. 👍 Your output of that For the future, I have been little bit confused if database migration commands should be run while connected to the immich database or not, and if user should be the admin user (or one with admin rights) or the immich user. I think that might be something that could be maybe improved in future release notes. Otherwise they have been really good. 👍 |
Beta Was this translation helpful? Give feedback.
-
Thanks for the feedback! We'll keep this in mind for future updates. |
Beta Was this translation helpful? Give feedback.
-
|
I'm a bit confused. Does updating to 1.95.0 from 1.94.1 and going to pgvecto.rs 0.2 would break something? |
Beta Was this translation helpful? Give feedback.
-
|
Can you be more specific on the question? Breaking change means that you need to take steps on your end for the update to be successful. You should always have backups of your images and database regardless. |
Beta Was this translation helpful? Give feedback.
-
|
In the release notes there's the following: Please note that the extension cannot be changed after a successful startup (i.e., migrations have run). This means you can't switch to pgvector from an existing instance with pgvecto.rs. It must be a new instance or an instance coming from 1.90.2 or older. Additionally, some features may not work quite as well with pgvector. I have a running instance that's upgraded to 1.94.x. Does the text above mean that if I've to try upgrading my immich instance that'd screw something up? |
Beta Was this translation helpful? Give feedback.
-
|
No, that's referring to if you tried to change from the |
Beta Was this translation helpful? Give feedback.
-
|
Oh my god, I hope the future updates will make fewer changes to postgres, because I am using an existing postgres, and every change means risk… |
Beta Was this translation helpful? Give feedback.
-
|
Sorry, this was a very big update to pgvecto.rs - later updates to pgvecto.rs will be a lot smoother (and optional). For transparency, we do plan on using two extensions in a later release to improve search: |
Beta Was this translation helpful? Give feedback.
-
|
Anyone else find the video under the OAuth encryption algorithm setting changes section not working? I'm having trouble figuring out how to change the Authentik signing key to RS256 |
Beta Was this translation helpful? Give feedback.
-
|
Where you specify the "Redirect URIs" for immich (providers > update/edit provider) you need to select a "Signing Key". No key = HS256. A selected key = RS256. |
Beta Was this translation helpful? Give feedback.
-
|
It looks like the Administration/Repair/Untracks files lists all archived items? Just a quick fix 👍 |
Beta Was this translation helpful? Give feedback.
-
|
Already fixed #7334 |
Beta Was this translation helpful? Give feedback.
-
|
Glad to see this is just a minor issue. Not sure if it's the same bug but I also see a bunch of |
Beta Was this translation helpful? Give feedback.
-
|
I suppose these |
Beta Was this translation helpful? Give feedback.
-
|
Can we already search on the filename again? This is crucial for debugging etc... |
Beta Was this translation helpful? Give feedback.
-
|
This was the release I finally gave up trying to run postgres as a regular user. Immich really wants pg superpowers for all these migrations and it's too much hassle for me to recreate them all. Oh well. :-) |
Beta Was this translation helpful? Give feedback.
-
|
I think this change send immich over the edge for me. I just spend two hours trying to migrate from pgvecto.rs from 0.1.11 to 0.2.0 and was not successful. Then spend another hour to recover the backup (that's not really an immich or pgvecto.rs problem, still didn't contribute to my good mood). I run my infrastructure on a time budget and immich definitely burned all its budget for the next months with this upgrade. Usually upgrades become less involved over time and usually end up in the sub minute amounts of effort per week. Immich seems to grow in effort involved for updates with almost every update since pgvecto.rs was introduced. I tried to handle it. But maintaining a database image, watching out for compatibility between mobile apps, server, database extensions, and the immich and helmchart version just get too involved. I can't even point out a specific issue, migrations fail, the pgvecto.rs version in the pg_extensions table was wrong, the extension doesn't support database clusters, required schemas don't exist, … The good news is, after a few weeks of the release of pgvecto.rs, most of the issues are already described and described in the pgvecto.rs' issue tracker along with workarounds. But that doesn't really solve the amount of time one has to invest. I think my conclusion is: I don't think immich is currently suitable for people to run it in their free time, there is too much experimental tech involved. I think immich is a fantastic app and provides such a great User experience, maybe I'll revisit it at some point in the future. |
Beta Was this translation helpful? Give feedback.
-
|
Sorry man, but you have a fair point. Without knowing more about your setup and the error you are running into, it will be hard for us to help. Just holla at us if you need help solving the issue |
Beta Was this translation helpful? Give feedback.
-
|
Sorry, the upgrade was definitely rough in a lot of cases between the schema change, permissions, etc. The silver lining is that we don't foresee anything like this in the coming months. I can help you get things back up and running if you can make a discussion for it or reach out on Discord. But I totally get it if you don't have the bandwidth for it. |
Beta Was this translation helpful? Give feedback.
-
|
Hello again, first of all, sorry, if that previous statement might read a bit harsh, which was probably due to quite some frustration. Today I managed to migrate from vector.rs to pgvector and this seems to work just fine. Even though it says it's not official supported to migrate according to the release notes with some fiddling it works. Especially thanks to your hint, @mertalev: #7310 (reply in thread) I drew inspiration from the recent blog post by someone in the discussions: #5532 (reply in thread) And yes, it works. I need to reindex all faces, which is mildly annoying, but now it seems to be all stable and just working, so 👍🏻 (including a bunch of failover tests for the database, all smooth sailing). My take away is, while vecto.rs is certainly exciting tech, I think it would have been a better choice to use pgvector first and make vecto.rs an option, rather than the other way around. |
Beta Was this translation helpful? Give feedback.
-
|
Thanks for the feedback! Glad to hear you managed to get things working. I think pgvector is a good choice in your case since pgvecto.rs doesn't support streaming replication. I also see where you're coming from in terms of the extension choice. However, I'll point out that barring streaming replication (which they're aware of and plan to support), pretty much all of the issues with it have been about the upgrade rather than the extension itself. By contrast, the limitations of pgvector are inherent to the extension, and it's unclear when (or if) they'll be addressed. If we primarily targeted pgvector, it would have had implications for our design process and the features we could realistically support. It's better for us to go with the extension that lets us be more ambitious. |
Beta Was this translation helpful? Give feedback.
-
|
Unfortunately this update broke something on my instance. When I visited the website again, I had to create an admin account because I was the first user and thus I couldn't see any pictures from my old account. |
Beta Was this translation helpful? Give feedback.
and others
-
v1.95.0
Warning
1. Upgrade
pgvecto.rsto stable version0.2.0for enhanced searchStep 1: Change the
docker-compose.ymldatabase image from0.1.11to0.2.0[...] database: container_name: immich_postgres - image: tensorchord/pgvecto-rs:pg14-v0.1.11@sha256:0335a1a22f8c5dd1b697f14f079934f5152eaaa216c09b61e293be285491f8ee + image: tensorchord/pgvecto-rs:pg14-v0.2.0@sha256:90724186f0a3517cf6914295b5ab410db9ce23190a2d9d0b9dd6463e3fa298f0 environment: POSTGRES_PASSWORD: ${DB_PASSWORD} POSTGRES_USER: ${DB_USERNAME} POSTGRES_DB: ${DB_DATABASE_NAME} volumes: - pgdata:/var/lib/postgresql/data restart: always [...]Step 2: Perform
docker compose pullStep 3:
a) If Immich is a Postgres superuser (default)
Bring the stack up with
docker compose upWhen the server starts up, it will log a message like this:
This is normal. Continue to Step 4.
b) If Immich is not a Postgres superuser
If Immich doesn't have superuser permissions, you'll need to bring up the database and run a few commands manually:
If you run into issue, see this comment for a potential fix
Step 4: Terminate and restart the stack
Bring the stack down (or terminate with ctrl + c) with:
Then bring it back up:
You'll run into a message saying:
This is normal. The server will do some magic and start to work.
Step 5: Enjoy the new ✨search enhancements✨
2. OAuth encryption algorithm setting changes
OAuth setups using
HS256(mainly Authentik) will need to either (1) update the signing algorithm in Immich or (2) specify a signing key in the provider settings (so that it usesRS256instead).Specify a signing key in Authentik:
Screencast.from.02-02-2024.12.05.04.AM.webm
New Immich OAuth Setting
Background
RS256is generally better thanHS256.RS256is pretty much the most commonly used algorithm. The client library we use for open-id defaults toRS256. It's very easy to setup Authentik without specifying a signing key, which will default to useHS256. The original implementation added a hack/fallback toHS256in some conditions to try to handle that situation. The current code removes the fallback, and adds a specificSigning Algortithmsetting which can be explicitly set. Alternatively, the issue could be fixed by specifying a signing key in Authentik.References:
Highlights
Welcome to version
v1.95.0of Immich. This is one of the longest stretches since the last release of Immich for the past year, we only had 150+ PRs merged since the last release. There are many new improvements and features in this release that we are very excited to introduce to you.Enhanced search feature
This feature is available on the Web only as of this release
This release adds a highly anticipated feature - advanced search with filters by date, location and more. What's more is that these filters are also compatible with smart search, so you can add text to sort by relevance at the same time.
Results are also no longer capped at 100 - scrolling down will fetch more and more assets.
pgvectorcompatibilityAs part of the upgrade to pgvecto.rs 0.2, we've also added pgvector support for environments where pgvecto.rs can't be used. Adding
DB_VECTOR_EXTENSION=pgvectorto the.envfile will use pgvector instead (assuming your Postgres instance has pgvector installed). We'd like to give a special shoutout to the pgvecto.rs team for adding a compatibility mode that makes it easier for us to support both extensions.Please note that the extension cannot be changed after a successful startup (i.e., migrations have run). This means you can't switch to pgvector from an existing instance with pgvecto.rs. It must be a new instance or an instance coming from 1.90.2 or older. Additionally, some features may not work quite as well with pgvector.
If you're upgrading from an old version of Immich, the migrations will take some time - don't worry if the server doesn't start up immediately.
Show partner's photos and videos on the map
This feature is available on the Web only as of this release
You can now toggle the option to include partners' assets on the map view.
Gradient placeholder on the mobile app
iOS background backup on WIFI option
You can now toggle this option only to allow background backup while the device is connected to the WIFI network.
External library import path validation
Several users struggle with getting import paths correct with external libraries. This version adds several checks and validations so that the user gets feedback on what went wrong.
CLI release
New CLI version 2.0.8. This version supports running inside Docker without needing Node.js installed, which helps on some platforms. Under the hood, it has been migrated to the new API version, uses
vitestinstead ofjest, and has seen several improvements and bug fixes.And as always, bugs are fixed, and many other improvements also come with this release.
Please consider supporting the project.
Support
If you find the project helpful, you can support Immich via the following channels.
It is a great way to let me know that you want me to continue developing and working on this project for years to come.
What's Changed
🗄️ Server
getAllAssetsendpoint includes motion part of LivePhotos by @alextran1502 in fix(server):getAllAssetsendpoint includes motion part of LivePhotos #7194📱 Mobile
🖥️ Web
🧠 Machine Learning
⚡ CLI
📓 Documentation
🔨 Maintenance
form-datadependency by @benmccann in chore: removeform-datadependency #6876rollup-plugin-visualizerand removelodashby @benmccann in chore: setuprollup-plugin-visualizerand removelodash#6974Other changes
New Contributors
Full Changelog: v1.94.1...v1.95.0
This discussion was created from the release v1.95.0.
Beta Was this translation helpful? Give feedback.
All reactions