Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Deadlock while running on GPU #187

Open
pierre-fribourg-context opened this issue Oct 23, 2021 · 1 comment
Open

Deadlock while running on GPU #187

pierre-fribourg-context opened this issue Oct 23, 2021 · 1 comment

Comments

@pierre-fribourg-context

Hi all,
first, thanks for this great work.

I encounter a weird issue while testing decord on GPU on my computer.
I am running the following benchmark command:

python3 bench_decord.py --file /my_video.mp4 for CPU
python3 bench_decord.py --file /my_video.mp4 --gpu 0 for GPU

It is working fine on CPU ending with the following line:

300 frames, elapsed time for random access(accurate): 25.084531545639038

But on GPU it deadlocks almost right away after this line:

[h264 @ 0x171d080] mmco: unref short failure

This appends while running localy or through docker (from decord/gpu.Dockerfile) with nvdia-runtime enabled

Here is my nvidia-smi output (its the same locally or from inside the docker):

NVIDIA-SMI 470.63.01 Driver Version: 470.63.01 CUDA Version: 11.4

From inside the docker I don't see any process lines in nvdia-smi, but locally I crealy see the process line jumping onto the GPU as here:

| 0 N/A N/A 5444 C python3 205MiB |

GPU usage keep very low, and it deadlocks for ever.

Do I have to switch to another version of CUDA maybe ?

Thanks a lot.

@stdKonjac
Copy link

I meet the same problem, have you solved it?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants