-
Notifications
You must be signed in to change notification settings - Fork 13.7k
Closed
Labels
Description
Git commit
is the CUDA illigal memory bug 75 fixed? many of us had these crashes in the past few days. reverting to versions 5+ days ago fixed it for me
Operating systems
Linux
GGML backends
CUDA
Problem description & steps to reproduce
just run any model and after firs or few prompts it crash with illegal memory : 75
First Bad Commit
couple days ago
Compile command
cmake CUDA=on CUDA archs: 86, 89, 120Relevant log output
but it didnt matter truning on or off gpus or which gpus where used its alwasy the last device in the list that causes the crash