Could not decode frame

[atombysx]

Is there an existing issue for this?

• I have searched the existing issues

Bug description

Hi, I've been analyzing my videos with
deeplabcut.analyze_videos(path_config_file, video, videotype='.avi', save_as_csv=True)

Most of the time, it's running well and outputs are all good.

But sometimes the following error pops out:
/home/adam/anaconda3/envs/DLC/lib/python3.9/site-packages/deeplabcut/pose_estimation_tensorflow/predict_videos.py:888: UserWarning: Could not decode frame #112637. warnings.warn(f"Could not decode frame #{counter}.") /home/adam/anaconda3/envs/DLC/lib/python3.9/site-packages/deeplabcut/pose_estimation_tensorflow/predict_videos.py:888: UserWarning: Could not decode frame #112638. warnings.warn(f"Could not decode frame #{counter}.") /home/adam/anaconda3/envs/DLC/lib/python3.9/site-packages/deeplabcut/pose_estimation_tensorflow/predict_videos.py:888: UserWarning: Could not decode frame #112639. warnings.warn(f"Could not decode frame #{counter}.")

It keeps going on until the last frame of the video. When I check the output and plotting, the frames starting from first line of this message all had likelihood value=0 for all labels, and all the labels have coordinates = 0.

This can be fixed by deleting the outputs and re-running the same line of code (sometimes keeps having the same issue but at different and random frames...).

So overall, it can be fixed but it's very annoying to detect which videos had the issue and re-run it when doing batch processing.

Operating System

Ubuntu 22.04.3 LTS

DeepLabCut version

dlc version 2.3.8

DeepLabCut mode

single animal

Device type

gpu NVIDIA GEFORCE RTX2080

Steps To Reproduce

No response

Relevant log output

No response

Anything else?

No response

Code of Conduct

• I agree to follow this project's Code of Conduct

[SonnoeVeco]

I have the same bug with DLC 2.3.8., Windows 11

[n-poulsen]

Hi @atombysx and @SonnoeVeco! This message is output when the library we use to read the video cannot read a frame (so then DeepLabCut cannot process it).

I think there are two likely reasons why this would happen:

1. Your video isn't correctly encoded (or it's corrupt) - in that case I would try re-encoding the videos with ffmpeg (with ffmpeg -i your_video.mp4 -c:v libx264 -crf 18 output_video_name.mp4 - you can find some tips here)
2. The video is correctly encoded, but the number of frames set in the video metadata is incorrect (so there are no extra frames to process). In this case, re-encoding the video would also solve that.

Please let me know if doing this reliably fixes your issues!

[n-poulsen]

Closing as stale