[Issue]: Error in Embedded Image Extractor

[Brancliff]

Please describe your bug

I'm trying to fill out my Jellyfin with YouTube videos, and I'm using the Embedded Image Extractor with the intent to show the embedded thumbnail of the YouTube video as the main image for each episode. But whenever I do this, I get an error with the image extraction, and all of the episodes in the folder get the same episode image. I've attached some logs at the bottom of this post.

The weird thing is, when I have this problem, I can use ffmpeg to extract the thumbnail images myself just fine. So I'm not sure what's causing trouble with Jellyfin using ffmpeg to extract the thumbnail images.

Jellyfin Version

10.8.4

Environment

- OS: Linux
- Virtualization: Docker
- Clients: Browser
- Browser: Vivaldi v5.0.2497.32
- FFmpeg Version: MediaBrowser.MediaEncoding.Encoder.MediaEncoder: Found ffmpeg version "5.1"
- Plugins: YouTubeMetadata (though, I don't think this should be a factor - the thumbnail info is already embedded into the file)
- Storage: Local

Jellyfin logs

[15:02:41] [ERR] [64] MediaBrowser.MediaEncoding.Encoder.MediaEncoder: ffmpeg image extraction failed for file:"/media/YouTube/Vargskelethor/Dwarf Fortress Adventure Mode/Vargskelethor 2015-12-05 Dwarf Fortress (Adventure Mode) (Part 4) [q2hM5bm1U4Q].mp4"
[15:02:41] [ERR] [64] MediaBrowser.Providers.TV.EpisodeMetadataService: Error in Embedded Image Extractor
MediaBrowser.Common.FfmpegException: ffmpeg image extraction failed for file:"/media/YouTube/Vargskelethor/Dwarf Fortress Adventure Mode/Vargskelethor 2015-12-05 Dwarf Fortress (Adventure Mode) (Part 4) [q2hM5bm1U4Q].mp4"
   at MediaBrowser.MediaEncoding.Encoder.MediaEncoder.ExtractImageInternal(String inputPath, String container, MediaStream videoStream, Nullable`1 imageStreamIndex, Nullable`1 threedFormat, Nullable`1 offset, Boolean useIFrame, Nullable`1 targetFormat, CancellationToken cancellationToken)
   at MediaBrowser.MediaEncoding.Encoder.MediaEncoder.ExtractImage(String inputFile, String container, MediaStream videoStream, Nullable`1 imageStreamIndex, MediaSourceInfo mediaSource, Boolean isAudio, Nullable`1 threedFormat, Nullable`1 offset, Nullable`1 targetFormat, CancellationToken cancellationToken)
   at MediaBrowser.Providers.MediaInfo.EmbeddedImageProvider.GetEmbeddedImage(Video item, ImageType type, CancellationToken cancellationToken)
   at MediaBrowser.Providers.Manager.ItemImageProvider.RefreshFromProvider(BaseItem item, IDynamicImageProvider provider, ImageRefreshOptions refreshOptions, TypeOptions savedOptions, ICollection`1 downloadedImages, RefreshResult result, CancellationToken cancellationToken)

[jellyfin-bot]

This issue has gone 120 days without comment. To avoid abandoned issues, it will be closed in 21 days if there are no new comments.

If you're the original submitter of this issue, please comment confirming if this issue still affects you in the latest release or master branch, or close the issue if it has been fixed. If you're another user also affected by this bug, please comment confirming so. Either action will remove the stale label.

This bot exists to prevent issues from becoming stale and forgotten. Jellyfin is always moving forward, and bugs are often fixed as side effects of other changes. We therefore ask that bug report authors remain vigilant about their issues to ensure they are closed if fixed, or re-confirmed - perhaps with fresh logs or reproduction examples - regularly. If you have any questions you can reach us on Matrix or Social Media.

[Shadowghost]

Can you post the file or a short sample which is failing so the error can be reproduced?

[Brancliff]

Hey! Thanks for coming to the thread.

I've uploaded a video that I've had this problem with to Google Drive. It's 622MB, which I hope isn't much of a problem - but if it is, let me know, and I can look for a smaller video that had the issue. It's an investigation about a strange gamer on Team Fortress 2 and it's really interesting :>

https://drive.google.com/file/d/1Xcmv8B8lLQ2i5w46TRWBkKy1zbaXGBh0/view?usp=sharing

Anyways, the thumbnail already embedded in the videofile, which is what I'm trying to get to output to Jellyfin, looks like this:

However, what I actually ended up getting instead was this:

Under Manage Library > Image fetches, the top priority is to use Embedded Image Extractor.

Additionally, this is a part of what was in my Jellyfin's container logs:

[04:59:12] [WRN] [17] Jellyfin.Server.Middleware.ResponseTimeMiddleware: Slow HTTP Response from http://10.0.0.147:4004/System/ActivityLog/Entries?startIndex=0&limit=7&minDate=2023-01-27T05%3A00%3A06.383Z&hasUserId=true to 10.0.0.241 in 0:00:07.2467635 with Status Code 200
[04:59:17] [WRN] [50] Jellyfin.Server.Middleware.ResponseTimeMiddleware: Slow HTTP Response from http://10.0.0.147:4004/Libraries/AvailableOptions?LibraryContentType=movies&IsNewLibrary=false to 10.0.0.241 in 0:00:03.232033 with Status Code 200
[04:59:23] [WRN] [41] Jellyfin.Server.Middleware.ResponseTimeMiddleware: Slow HTTP Response from http://10.0.0.147:4004/Items/ff0cc7b970aaa46586eec6083410b77b/Images/Primary?fillHeight=300&fillWidth=200&quality=96&tag=fa9ce1f2ce50c76e3f46b131603068f6 to 10.0.0.241 in 0:00:35.2179599 with Status Code 200
[04:59:30] [ERR] [63] MediaBrowser.MediaEncoding.Encoder.MediaEncoder: ffmpeg image extraction failed for file:"/media/Documentaries/The Story of TF2s Strangest Player/Elmaxo 2022-08-12 The Story of TF2s Strangest Player [FrQJIIbzoyQ].mp4"
[04:59:30] [ERR] [63] MediaBrowser.MediaEncoding.Encoder.MediaEncoder: I-frame image extraction failed, will attempt standard way. Input: file:"/media/Documentaries/The Story of TF2s Strangest Player/Elmaxo 2022-08-12 The Story of TF2s Strangest Player [FrQJIIbzoyQ].mp4"
MediaBrowser.Common.FfmpegException: ffmpeg image extraction failed for file:"/media/Documentaries/The Story of TF2s Strangest Player/Elmaxo 2022-08-12 The Story of TF2s Strangest Player [FrQJIIbzoyQ].mp4"
at MediaBrowser.MediaEncoding.Encoder.MediaEncoder.ExtractImageInternal(String inputPath, String container, MediaStream videoStream, Nullable1 imageStreamIndex, Nullable1 threedFormat, Nullable1 offset, Boolean useIFrame, Nullable1 targetFormat, CancellationToken cancellationToken)
at MediaBrowser.MediaEncoding.Encoder.MediaEncoder.ExtractImage(String inputFile, String container, MediaStream videoStream, Nullable1 imageStreamIndex, MediaSourceInfo mediaSource, Boolean isAudio, Nullable1 threedFormat, Nullable1 offset, Nullable1 targetFormat, CancellationToken cancellationToken)
[05:00:30] [ERR] [10] MediaBrowser.MediaEncoding.Encoder.MediaEncoder: ffmpeg image extraction failed for file:"/media/Documentaries/The Story of TF2s Strangest Player/Elmaxo 2022-08-12 The Story of TF2s Strangest Player [FrQJIIbzoyQ].mp4"
[05:00:30] [ERR] [10] MediaBrowser.MediaEncoding.Encoder.MediaEncoder: I-frame image extraction failed, will attempt standard way. Input: file:"/media/Documentaries/The Story of TF2s Strangest Player/Elmaxo 2022-08-12 The Story of TF2s Strangest Player [FrQJIIbzoyQ].mp4"
MediaBrowser.Common.FfmpegException: ffmpeg image extraction failed for file:"/media/Documentaries/The Story of TF2s Strangest Player/Elmaxo 2022-08-12 The Story of TF2s Strangest Player [FrQJIIbzoyQ].mp4"
at MediaBrowser.MediaEncoding.Encoder.MediaEncoder.ExtractImageInternal(String inputPath, String container, MediaStream videoStream, Nullable1 imageStreamIndex, Nullable1 threedFormat, Nullable1 offset, Boolean useIFrame, Nullable1 targetFormat, CancellationToken cancellationToken)
at MediaBrowser.MediaEncoding.Encoder.MediaEncoder.ExtractImage(String inputFile, String container, MediaStream videoStream, Nullable1 imageStreamIndex, MediaSourceInfo mediaSource, Boolean isAudio, Nullable1 threedFormat, Nullable1 offset, Nullable1 targetFormat, CancellationToken cancellationToken)
[05:00:30] [ERR] [35] MediaBrowser.MediaEncoding.Encoder.MediaEncoder: ffmpeg image extraction failed for file:"/media/Documentaries/The Story of TF2s Strangest Player/Elmaxo 2022-08-12 The Story of TF2s Strangest Player [FrQJIIbzoyQ].mp4"
[05:00:30] [ERR] [35] MediaBrowser.Providers.Movies.MovieMetadataService: Error in Embedded Image Extractor
MediaBrowser.Common.FfmpegException: ffmpeg image extraction failed for file:"/media/Documentaries/The Story of TF2s Strangest Player/Elmaxo 2022-08-12 The Story of TF2s Strangest Player [FrQJIIbzoyQ].mp4"
at MediaBrowser.MediaEncoding.Encoder.MediaEncoder.ExtractImageInternal(String inputPath, String container, MediaStream videoStream, Nullable1 imageStreamIndex, Nullable1 threedFormat, Nullable1 offset, Boolean useIFrame, Nullable1 targetFormat, CancellationToken cancellationToken)
at MediaBrowser.MediaEncoding.Encoder.MediaEncoder.ExtractImage(String inputFile, String container, MediaStream videoStream, Nullable1 imageStreamIndex, MediaSourceInfo mediaSource, Boolean isAudio, Nullable1 threedFormat, Nullable1 offset, Nullable1 targetFormat, CancellationToken cancellationToken)
at MediaBrowser.Providers.MediaInfo.EmbeddedImageProvider.GetEmbeddedImage(Video item, ImageType type, CancellationToken cancellationToken)
at MediaBrowser.Providers.Manager.ItemImageProvider.RefreshFromProvider(BaseItem item, IDynamicImageProvider provider, ImageRefreshOptions refreshOptions, TypeOptions savedOptions, ICollection`1 downloadedImages, RefreshResult result, CancellationToken cancellationToken)
[05:01:01] [WRN] [103] Jellyfin.Server.Middleware.ResponseTimeMiddleware: Slow HTTP Response from http://10.0.0.147:4004/Items/2db04e625547e69aea8bfe224143f988/Images/Chapter/1?maxWidth=400&tag=879d16f1b7b4808006290aa65fe51a3b&quality=90 to 10.0.0.241 in 0:00:00.5761561 with Status Code 200
[05:01:01] [WRN] [94] Jellyfin.Server.Middleware.ResponseTimeMiddleware: Slow HTTP Response from http://10.0.0.147:4004/Items/0bd068bf84bd1fab1f9f463962a834d5/Images/Backdrop?fillHeight=203&fillWidth=360&quality=96&tag=f0bf94b372df808a202fa65e494bdccc to 10.0.0.241 in 0:00:05.8530822 with Status Code 200

I've also disabled the YouTube metadata plugin to see if the problem still persists. (it does)

[jellyfin-bot]

This issue has gone 120 days without comment. To avoid abandoned issues, it will be closed in 21 days if there are no new comments.

If you're the original submitter of this issue, please comment confirming if this issue still affects you in the latest release or master branch, or close the issue if it has been fixed. If you're another user also affected by this bug, please comment confirming so. Either action will remove the stale label.

This bot exists to prevent issues from becoming stale and forgotten. Jellyfin is always moving forward, and bugs are often fixed as side effects of other changes. We therefore ask that bug report authors remain vigilant about their issues to ensure they are closed if fixed, or re-confirmed - perhaps with fresh logs or reproduction examples - regularly. If you have any questions you can reach us on Matrix or Social Media.

[evrial]

Confirming the same problem, not a single file has Youtube thumbnails.

jellyfin --version
Jellyfin.Server 10.8.11.0

Sep 26 15:41:47 DietPi jellyfin[509]: [15:41:47] [ERR] ffmpeg image extraction failed for file:"/mnt/ssd/dietpi_userdata/Video/«КАПИТАЛ» КРАТКО 06： Золотые деньги [mblQkR_Wp78].mkv"
Sep 26 15:41:47 DietPi jellyfin[509]: [15:41:47] [ERR] I-frame image extraction failed, will attempt standard way. Input: file:"/mnt/ssd/dietpi_userdata/Video/«КАПИТАЛ» КРАТКО 06： Золотые деньги [mblQkR_Wp78].mkv"
Sep 26 15:41:47 DietPi jellyfin[509]: MediaBrowser.Common.FfmpegException: ffmpeg image extraction failed for file:"/mnt/ssd/dietpi_userdata/Video/«КАПИТАЛ» КРАТКО 06： Золотые деньги [mblQkR_Wp78].mkv"
Sep 26 15:41:47 DietPi jellyfin[509]:    at MediaBrowser.MediaEncoding.Encoder.MediaEncoder.ExtractImageInternal(String inputPath, String container, MediaStream videoStream, Nullable`1 imageStreamIndex, Nullable`1 threedFormat, Nullable`1 offset, Boolean useIFrame, Nullable`1 targetFormat, CancellationToken cancellationToken)
Sep 26 15:41:47 DietPi jellyfin[509]:    at MediaBrowser.MediaEncoding.Encoder.MediaEncoder.ExtractImage(String inputFile, String container, MediaStream videoStream, Nullable`1 imageStreamIndex, MediaSourceInfo mediaSource, Boolean isAudio, Nullable`1 threedFormat, Nullable`1 offset, Nullable`1 targetFormat, CancellationToken cancellationToken)
Sep 26 15:41:47 DietPi jellyfin[509]: [15:41:47] [ERR] ffmpeg image extraction failed for file:"/mnt/ssd/dietpi_userdata/Video/«КАПИТАЛ» КРАТКО 06： Золотые деньги [mblQkR_Wp78].mkv"
Sep 26 15:41:47 DietPi jellyfin[509]: [15:41:47] [ERR] Error in Embedded Image Extractor
Sep 26 15:41:47 DietPi jellyfin[509]: MediaBrowser.Common.FfmpegException: ffmpeg image extraction failed for file:"/mnt/ssd/dietpi_userdata/Video/«КАПИТАЛ» КРАТКО 06： Золотые деньги [mblQkR_Wp78].mkv"
Sep 26 15:41:47 DietPi jellyfin[509]:    at MediaBrowser.MediaEncoding.Encoder.MediaEncoder.ExtractImageInternal(String inputPath, String container, MediaStream videoStream, Nullable`1 imageStreamIndex, Nullable`1 threedFormat, Nullable`1 offset, Boolean useIFrame, Nullable`1 targetFormat, CancellationToken cancellationToken)
Sep 26 15:41:47 DietPi jellyfin[509]:    at MediaBrowser.MediaEncoding.Encoder.MediaEncoder.ExtractImage(String inputFile, String container, MediaStream videoStream, Nullable`1 imageStreamIndex, MediaSourceInfo mediaSource, Boolean isAudio, Nullable`1 threedFormat, Nullable`1 offset, Nullable`1 targetFormat, CancellationToken cancellationToken)
Sep 26 15:41:47 DietPi jellyfin[509]:    at MediaBrowser.Providers.MediaInfo.EmbeddedImageProvider.ExtractAttachment(Video item, MediaAttachment attachmentStream, MediaSourceInfo mediaSource, CancellationToken cancellationToken)
Sep 26 15:41:47 DietPi jellyfin[509]:    at MediaBrowser.Providers.MediaInfo.EmbeddedImageProvider.GetEmbeddedImage(Video item, ImageType type, CancellationToken cancellationToken)
Sep 26 15:41:47 DietPi jellyfin[509]:    at MediaBrowser.Providers.Manager.ItemImageProvider.RefreshFromProvider(BaseItem item, IDynamicImageProvider provider, ImageRefreshOptions refreshOptions, TypeOptions savedOptions, ICollection`1 downloadedImages, RefreshResult result, CancellationToken cancellationToken)

[gunslinger123]

Confirming the bug exists on 10.8.11, downgrading to 10.8.10 and refreshing metadata, replacing all metadata, and checking replace existing images resolves the issue in my youtube library

[Brancliff]

Someone moved this issue to 'insufficient data'.
What more data should we give out?