Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

running bigdl inference while click the mouse will cause GPU hang issue #11405

Open
ganghe opened this issue Jun 24, 2024 · 3 comments
Open

running bigdl inference while click the mouse will cause GPU hang issue #11405

ganghe opened this issue Jun 24, 2024 · 3 comments

Comments

@ganghe
Copy link

ganghe commented Jun 24, 2024

Hi Team,

I'd like to file this issue, hopefully, you guys can investigate this issue from top to bottom.
My environment is as below,
Ubuntu 22.04.4 LTS on MTL with kernel 6.6.25-060625-generic
OneAPI 24.01 + ipex-llm 2.1.0b20240610

The reproduce steps,

Login Ubuntu desktop UI
Launcher terminal and run generate_tinyllama-1.1b.py repeatedly
at the same time, click the mouse
After a while, the system desktop loses response.
then, you have to login the system via SSH remotely.
you can find gnome-shell is using CPU with 100% rate.
you also can find GPU hang log via dmesg command.

By the way, this issue should be caused by Linux kernel part.
If I upgrade the kernel to 6.9.0-060900-generic, the issue can not be reproduced.

Thanks
Gang

@ganghe
Copy link
Author

ganghe commented Jun 24, 2024

GPU_hang_log
gnome_shell

@ganghe
Copy link
Author

ganghe commented Jun 24, 2024

@qiuxin2012
Copy link
Contributor

Thanks for sharing your experience. OneAPI 2024.1 and Linux Kernel > 6.5 are not fully tested for ipex_llm.We will try this case when we test the new kernel.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants