forked from ggml-org/llama.cpp
-
Notifications
You must be signed in to change notification settings - Fork 598
Open
Description
Describe the Issue
I use this command:
python koboldcpp.py --model "E:/models/knoveleng_Open-RS3-Q6_K.gguf" --skiplauncher --useclblast 0 0 --gpulayers 29 --contextsize 4096
and I get:
Traceback (most recent call last):
File "C:\koboldcpp\koboldcpp.py", line 6069, in <module>
main(launch_args=parser.parse_args(),default_args=parser.parse_args([]))
File "C:\koboldcpp\koboldcpp.py", line 5213, in main
kcpp_main_process(args,global_memory,using_gui_launcher)
File "C:\koboldcpp\koboldcpp.py", line 5610, in kcpp_main_process
loadok = load_model(modelname)
File "C:\koboldcpp\koboldcpp.py", line 1115, in load_model
ret = handle.load_model(inputs)
OSError: exception: access violation reading 0x000000005CC05C38
(The address at the end always changes, e.g. 0xFFFFFFFFFFFFFFFF, 0x000000005CC05C38, 0x0000000002093938...)
But, if I just keep rerunning the command, it works.
One time it worked but random tokens get generated.
I try again and it works just fine.
(The issue never happened if I use cpu instead of clblast.)
Additional Information:
Windows 10 Pro 21H1 19043.1110
Intel i5-5200U, Intel HD Graphics 5500, OpenCL 2.0
koboldcpp 1.86.2
Metadata
Metadata
Assignees
Labels
No labels