forcing full prompt re-processing due to lack of cache data in Qwern3.6 27B

[corrm]

Used model: https://huggingface.co/unsloth/Qwen3.6-27B-GGUF UD-Q4_K_XL

slot launch_slot_: id  0 | task 2505 | processing task, is_child = 0
slot update_slots: id  0 | task 2505 | new prompt, n_ctx_slot = 140032, n_keep = 0, task.n_tokens = 88675
slot update_slots: id  0 | task 2505 | n_past = 85490, slot.prompt.tokens.size() = 89584, seq_id = 0, pos_min = 89583, n_swa = 0
slot update_slots: id  0 | task 2505 | Checking checkpoint with [89323, 89323] against 85490...
slot update_slots: id  0 | task 2505 | Checking checkpoint with [89098, 89098] against 85490...
slot update_slots: id  0 | task 2505 | Checking checkpoint with [88974, 88974] against 85490...
slot update_slots: id  0 | task 2505 | Checking checkpoint with [88879, 88879] against 85490...
slot update_slots: id  0 | task 2505 | Checking checkpoint with [88789, 88789] against 85490...
slot update_slots: id  0 | task 2505 | Checking checkpoint with [88622, 88622] against 85490...
slot update_slots: id  0 | task 2505 | Checking checkpoint with [88535, 88535] against 85490...
slot update_slots: id  0 | task 2505 | Checking checkpoint with [88439, 88439] against 85490...
slot update_slots: id  0 | task 2505 | Checking checkpoint with [88257, 88257] against 85490...
slot update_slots: id  0 | task 2505 | Checking checkpoint with [88138, 88138] against 85490...
slot update_slots: id  0 | task 2505 | Checking checkpoint with [88000, 88000] against 85490...
slot update_slots: id  0 | task 2505 | Checking checkpoint with [87877, 87877] against 85490...
slot update_slots: id  0 | task 2505 | Checking checkpoint with [87749, 87749] against 85490...
slot update_slots: id  0 | task 2505 | Checking checkpoint with [87633, 87633] against 85490...
slot update_slots: id  0 | task 2505 | Checking checkpoint with [87512, 87512] against 85490...
slot update_slots: id  0 | task 2505 | Checking checkpoint with [87392, 87392] against 85490...
slot update_slots: id  0 | task 2505 | Checking checkpoint with [87268, 87268] against 85490...
slot update_slots: id  0 | task 2505 | Checking checkpoint with [87152, 87152] against 85490...
slot update_slots: id  0 | task 2505 | Checking checkpoint with [86967, 86967] against 85490...
slot update_slots: id  0 | task 2505 | Checking checkpoint with [86844, 86844] against 85490...
slot update_slots: id  0 | task 2505 | Checking checkpoint with [86768, 86768] against 85490...
slot update_slots: id  0 | task 2505 | Checking checkpoint with [86685, 86685] against 85490...
slot update_slots: id  0 | task 2505 | Checking checkpoint with [86609, 86609] against 85490...
slot update_slots: id  0 | task 2505 | Checking checkpoint with [86526, 86526] against 85490...
slot update_slots: id  0 | task 2505 | Checking checkpoint with [86450, 86450] against 85490...
slot update_slots: id  0 | task 2505 | Checking checkpoint with [86367, 86367] against 85490...
slot update_slots: id  0 | task 2505 | Checking checkpoint with [86291, 86291] against 85490...
slot update_slots: id  0 | task 2505 | Checking checkpoint with [86211, 86211] against 85490...
slot update_slots: id  0 | task 2505 | Checking checkpoint with [86135, 86135] against 85490...
slot update_slots: id  0 | task 2505 | Checking checkpoint with [86055, 86055] against 85490...
slot update_slots: id  0 | task 2505 | Checking checkpoint with [85979, 85979] against 85490...
slot update_slots: id  0 | task 2505 | Checking checkpoint with [85899, 85899] against 85490...
slot update_slots: id  0 | task 2505 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055)
slot update_slots: id  0 | task 2505 | erased invalidated context checkpoint (pos_min = 85899, pos_max = 85899, n_tokens = 85900, n_swa = 0, pos_next = 0, size = 149.626 MiB)
slot update_slots: id  0 | task 2505 | erased invalidated context checkpoint (pos_min = 85979, pos_max = 85979, n_tokens = 85980, n_swa = 0, pos_next = 0, size = 149.626 MiB)
slot update_slots: id  0 | task 2505 | erased invalidated context checkpoint (pos_min = 86055, pos_max = 86055, n_tokens = 86056, n_swa = 0, pos_next = 0, size = 149.626 MiB)
slot update_slots: id  0 | task 2505 | erased invalidated context checkpoint (pos_min = 86135, pos_max = 86135, n_tokens = 86136, n_swa = 0, pos_next = 0, size = 149.626 MiB)
slot update_slots: id  0 | task 2505 | erased invalidated context checkpoint (pos_min = 86211, pos_max = 86211, n_tokens = 86212, n_swa = 0, pos_next = 0, size = 149.626 MiB)
slot update_slots: id  0 | task 2505 | erased invalidated context checkpoint (pos_min = 86291, pos_max = 86291, n_tokens = 86292, n_swa = 0, pos_next = 0, size = 149.626 MiB)
slot update_slots: id  0 | task 2505 | erased invalidated context checkpoint (pos_min = 86367, pos_max = 86367, n_tokens = 86368, n_swa = 0, pos_next = 0, size = 149.626 MiB)
slot update_slots: id  0 | task 2505 | erased invalidated context checkpoint (pos_min = 86450, pos_max = 86450, n_tokens = 86451, n_swa = 0, pos_next = 0, size = 149.626 MiB)
slot update_slots: id  0 | task 2505 | erased invalidated context checkpoint (pos_min = 86526, pos_max = 86526, n_tokens = 86527, n_swa = 0, pos_next = 0, size = 149.626 MiB)
slot update_slots: id  0 | task 2505 | erased invalidated context checkpoint (pos_min = 86609, pos_max = 86609, n_tokens = 86610, n_swa = 0, pos_next = 0, size = 149.626 MiB)
slot update_slots: id  0 | task 2505 | erased invalidated context checkpoint (pos_min = 86685, pos_max = 86685, n_tokens = 86686, n_swa = 0, pos_next = 0, size = 149.626 MiB)
slot update_slots: id  0 | task 2505 | erased invalidated context checkpoint (pos_min = 86768, pos_max = 86768, n_tokens = 86769, n_swa = 0, pos_next = 0, size = 149.626 MiB)
slot update_slots: id  0 | task 2505 | erased invalidated context checkpoint (pos_min = 86844, pos_max = 86844, n_tokens = 86845, n_swa = 0, pos_next = 0, size = 149.626 MiB)
slot update_slots: id  0 | task 2505 | erased invalidated context checkpoint (pos_min = 86967, pos_max = 86967, n_tokens = 86968, n_swa = 0, pos_next = 0, size = 149.626 MiB)
slot update_slots: id  0 | task 2505 | erased invalidated context checkpoint (pos_min = 87152, pos_max = 87152, n_tokens = 87153, n_swa = 0, pos_next = 0, size = 149.626 MiB)
slot update_slots: id  0 | task 2505 | erased invalidated context checkpoint (pos_min = 87268, pos_max = 87268, n_tokens = 87269, n_swa = 0, pos_next = 0, size = 149.626 MiB)
slot update_slots: id  0 | task 2505 | erased invalidated context checkpoint (pos_min = 87392, pos_max = 87392, n_tokens = 87393, n_swa = 0, pos_next = 0, size = 149.626 MiB)
slot update_slots: id  0 | task 2505 | erased invalidated context checkpoint (pos_min = 87512, pos_max = 87512, n_tokens = 87513, n_swa = 0, pos_next = 0, size = 149.626 MiB)
slot update_slots: id  0 | task 2505 | erased invalidated context checkpoint (pos_min = 87633, pos_max = 87633, n_tokens = 87634, n_swa = 0, pos_next = 0, size = 149.626 MiB)
slot update_slots: id  0 | task 2505 | erased invalidated context checkpoint (pos_min = 87749, pos_max = 87749, n_tokens = 87750, n_swa = 0, pos_next = 0, size = 149.626 MiB)
slot update_slots: id  0 | task 2505 | erased invalidated context checkpoint (pos_min = 87877, pos_max = 87877, n_tokens = 87878, n_swa = 0, pos_next = 0, size = 149.626 MiB)
slot update_slots: id  0 | task 2505 | erased invalidated context checkpoint (pos_min = 88000, pos_max = 88000, n_tokens = 88001, n_swa = 0, pos_next = 0, size = 149.626 MiB)
slot update_slots: id  0 | task 2505 | erased invalidated context checkpoint (pos_min = 88138, pos_max = 88138, n_tokens = 88139, n_swa = 0, pos_next = 0, size = 149.626 MiB)
slot update_slots: id  0 | task 2505 | erased invalidated context checkpoint (pos_min = 88257, pos_max = 88257, n_tokens = 88258, n_swa = 0, pos_next = 0, size = 149.626 MiB)
slot update_slots: id  0 | task 2505 | erased invalidated context checkpoint (pos_min = 88439, pos_max = 88439, n_tokens = 88440, n_swa = 0, pos_next = 0, size = 149.626 MiB)
slot update_slots: id  0 | task 2505 | erased invalidated context checkpoint (pos_min = 88535, pos_max = 88535, n_tokens = 88536, n_swa = 0, pos_next = 0, size = 149.626 MiB)
slot update_slots: id  0 | task 2505 | erased invalidated context checkpoint (pos_min = 88622, pos_max = 88622, n_tokens = 88623, n_swa = 0, pos_next = 0, size = 149.626 MiB)
slot update_slots: id  0 | task 2505 | erased invalidated context checkpoint (pos_min = 88789, pos_max = 88789, n_tokens = 88790, n_swa = 0, pos_next = 0, size = 149.626 MiB)
slot update_slots: id  0 | task 2505 | erased invalidated context checkpoint (pos_min = 88879, pos_max = 88879, n_tokens = 88880, n_swa = 0, pos_next = 0, size = 149.626 MiB)
slot update_slots: id  0 | task 2505 | erased invalidated context checkpoint (pos_min = 88974, pos_max = 88974, n_tokens = 88975, n_swa = 0, pos_next = 0, size = 149.626 MiB)
slot update_slots: id  0 | task 2505 | erased invalidated context checkpoint (pos_min = 89098, pos_max = 89098, n_tokens = 89099, n_swa = 0, pos_next = 0, size = 149.626 MiB)
slot update_slots: id  0 | task 2505 | erased invalidated context checkpoint (pos_min = 89323, pos_max = 89323, n_tokens = 89324, n_swa = 0, pos_next = 0, size = 149.626 MiB)

[dsiMJ]

I'm seeing the same "forcing full prompt re-processing due to lack of cache data" warning, but in my case it leads to a CRASH, not just reprocessing.

My setup:

• Model: Qwen3.6-35B-A3B-UD-IQ4_XS (similar to issue's 27B)
• Version: b9297/b3310/b9460/b9496/b9505/b9518/b9524
• GPU: RTX 3090 (24GB)
• Context: 128K with rope-scale 2.0
• MTP speculative decoding enabled/disabled same behaviour

Log excerpt showing the crash:

17.08.523.147 W slot update_slots: id 0 | task 7224 | n_past = 11347, slot.prompt.tokens.size() = 39250
17.08.523.149 I slot update_slots: Checking checkpoint with [8191, 8191] against 11346...
17.08.541.769 W slot update_slots: restored context checkpoint (pos_min = 8191, pos_max = 8191, n_tokens = 8192, n_past = 8192)
17.08.541.773 W slot update_slots: erased invalidated context checkpoint (pos_min = 16383...)
[multiple erasures truncated]
17.08.549.925 W slot update_slots: erased invalidated context checkpoint (pos_min = 39021...)
D:\a\llama.cpp\llama.cpp\ggml\src\ggml-cuda\[ggml-cuda.cu:102](https://ggml-cuda.cu:102/): CUDA error
17.17.736.315 E CUDA error: an illegal memory access was encountered

Pattern:

• Works fine for 2-3 conversation turns
• On turn 3 or 4, forces full reprocessing after failing to find valid cache
• Then crashes with illegal memory access when trying to restore/erase checkpoints

[kripper]

I don't understand why we cannot have this?
#22921

[github-actions]

This issue was closed because it has been inactive for 14 days since being marked as stale.