[Feature]: Delete Duplicated Media #1666
Replies: 18 comments
-
|
Hi @swimminsparrow, we've already implemented duplicate identifier with sha1 checksum. A tool for managing and deleting duplicated content is also our further work. |
Beta Was this translation helpful? Give feedback.
-
|
Hi have this situation:
|
Beta Was this translation helpful? Give feedback.
-
This sounds like a bug. Where did you get the app? Can you provide more information on your setup and device info? |
Beta Was this translation helpful? Give feedback.
-
|
Android version: 1.28.0 build.38 |
Beta Was this translation helpful? Give feedback.
-
|
@swimminsparrow your backend version is really old. You'd better upgrade to the latest version 1.28 |
Beta Was this translation helpful? Give feedback.
-
The dedup feature has been available since 1.27. We are going with the convention that the mobile app and the server must be on the same version to ensure compatibility. |
Beta Was this translation helpful? Give feedback.
-
|
Hi @alextran1502 @panoti how can i upgrade the server version? thanks |
Beta Was this translation helpful? Give feedback.
-
|
You can do |
Beta Was this translation helpful? Give feedback.
-
|
Ok thank you. I suppose the feature does not work retroactively so i should clean the current situation with duplicates and make further check for the new uploads |
Beta Was this translation helpful? Give feedback.
-
|
FYI, new upload won't run into problem with duplication since we have the checking mechanism in place. The only edge case is the two identical files with two version, one is compressed and one is original, which will cause the duplication. |
Beta Was this translation helpful? Give feedback.
-
|
I'm also seeing some duplicate data after an initial upload via googlephotos takeout, then syncing my device photos. Guessing thats likely the edge case you speak of @alextran1502? |
Beta Was this translation helpful? Give feedback.
-
@joeShuff if the file is compressed then we will see the duplication since the hash value is different with the uncompressed file |
Beta Was this translation helpful? Give feedback.
-
|
In the android app it shows duplicated files, on the web app it doesn't, after logging out and in again and re-uploading. For example, if I go to the date 26 nov on the android app, it shows 6 pictures, 3 unique and 3 duplicated. If I go to the date 26 nov on my computer, it shows 3 picutres, 3 unique and 0 duplicated. After closing and re-opening the app this got fixed, but if I didn't close the app it stayed "duplicated". |
Beta Was this translation helpful? Give feedback.
-
|
It's worth noting too, that the sha1 hash is only unique per user. |
Beta Was this translation helpful? Give feedback.
-
Also I just noticed another problem, the "Backup up photo's and video's" counter is 0 (because the photo's and video's are already uploaded ig?) |
Beta Was this translation helpful? Give feedback.
-
This might be the state glitch when uploading and updating the timeline. I noticed that sometime the websocket doesn't close properly lead to two uploading events triggered and showing duplication. If closing and reopening the app fix it, this is just cosmetic bug and we will get to it sometimes in the future |
Beta Was this translation helpful? Give feedback.
-
If this is not correct, please open a separate issue and provide the steps you have taken to arrive at the problem. I am not sure which operations were done and what is the expectation outcome from your brief report |
Beta Was this translation helpful? Give feedback.
-
|
You can now use the deduplication utility for this my.immich.app/utilities/duplicates |
Beta Was this translation helpful? Give feedback.
-
Feature detail
A tool for managing and deleting duplicated content could be useful, checking the hash or the filename?
Platform
Web
Beta Was this translation helpful? Give feedback.
All reactions