Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Kernel Dead Issue #891

Closed
sivaji123256 opened this issue May 3, 2023 · 5 comments
Closed

Kernel Dead Issue #891

sivaji123256 opened this issue May 3, 2023 · 5 comments
Assignees
Labels
🐛 Bug Something isn't working

Comments

@sivaji123256
Copy link

Hi @BloodAxe @ofrimasad @jonathan-sha @spsancti @yurkovak ,
Thanks for the cool work. I was trying with the quick notebook on 5 min video.But the kernel was dead issue was rising.I couldn't run the inference. Any idea on why is happening ?

@dagshub
Copy link

dagshub bot commented May 3, 2023

@BloodAxe
Copy link
Collaborator

BloodAxe commented May 3, 2023

My guess that it is OOM error. In theory if the video has high resolution frames that we accumulate during processing may sum up and take all system memory. Do you mind sharing a video (or at least it's dimensions) you're trying to process?

@ranrubin ranrubin added the help wanted Extra attention is needed label May 4, 2023
@Lifeguard-alex
Copy link

i get the same problem on
yolo_nas_l.to(device).predict(input_video_path).save(output_video_path)
memory get all 125gb i have and crash + 2 gb of swap

i get this working ok on the same video on yolo 7 and 8 and yolox

i am infer on yolo_nas_l

@BloodAxe BloodAxe added the enhancement New feature or request label May 7, 2023
@Louis-Dupont
Copy link
Contributor

Hi @sivaji123256 and @Lifeguard-alex ,
Please check out #976, does this solve your issue ?

@Louis-Dupont Louis-Dupont self-assigned this May 11, 2023
@BloodAxe
Copy link
Collaborator

We have implemented memory-efficient predict for video in super-gradients 3.5.0.
So you are welcome to upgrade to a new version of SG which should not have this issue.

@BloodAxe BloodAxe added 3.5.0 🐛 Bug Something isn't working and removed enhancement New feature or request help wanted Extra attention is needed 3.5.0 labels Nov 23, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
🐛 Bug Something isn't working
Projects
None yet
Development

No branches or pull requests

5 participants