Skip to content

CUDA illigal memory bug 75 fixed? #13906

@fernandaspets

Description

@fernandaspets

Git commit

is the CUDA illigal memory bug 75 fixed? many of us had these crashes in the past few days. reverting to versions 5+ days ago fixed it for me

Operating systems

Linux

GGML backends

CUDA

Problem description & steps to reproduce

just run any model and after firs or few prompts it crash with illegal memory : 75

First Bad Commit

couple days ago

Compile command

cmake CUDA=on CUDA archs: 86, 89, 120

Relevant log output

but it didnt matter truning on or off gpus or which gpus where used its alwasy the last device in the list that causes the crash

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions