Skip to content

vk::Device::getFenceStatus: ErrorDeviceLost #1282

Description

@Najmulk424

Environment

OS: Windows (fill in exact build) — e.g. Windows 10/11 (build )

LM Studio version:

Model: gemma-3-4b-it-Q4_K_M.gguf (path from log: C:\Users\nazmu.lmstudio\models\lmstudio-community\gemma-3-4b-it-GGUF...)

GPU: Intel(R) Arc(TM) A750 Graphics (driver/version: ). Vulkan backend in use.

VRAM reported free at load: ~7567 MiB (see logs)

Backend: llama.cpp / Vulkan / LM Studio LLM engine

Steps to reproduce

Start LM Studio server (default HTTP endpoints appear).

Load the Gemma 3 4B model (GGUF Q4_K).

Trigger a generation (POST to /v1/chat/completions or use UI) that causes actual token prediction (n_predict > 0).

Observe error during prediction.

What I expected
Model to generate tokens normally without the Vulkan device being lost.

What actually happened
Prediction failed with a Vulkan device error and process logs show vk::Device::getFenceStatus: ErrorDeviceLost. Generation aborted.

Relevant log snippet

[LLM Engine bindings] PredictWorker::Execute - caught exception: vk::Device::getFenceStatus: ErrorDeviceLost
[lmstudio-llama-cpp] Error in predictTokens: vk::Device::getFenceStatus: ErrorDeviceLost
1 Error predicting: _0x340f8e [Error]: vk::Device::getFenceStatus: ErrorDeviceLost
at _0x40d3bf.LLMEngineWrapper.predictTokens (...\LM Studio\resources\app.webpack\lib\llmworker.js:85:29855)
at async _0x339349.predictTokens (...\llmworker.js:121:17859)
at async _0x339349.handleMessage (...\llmworker.js:121:7111) {
title: 'vk::Device::getFenceStatus: ErrorDeviceLost'
}

Full relevant log context (attach if possible)

Server started and endpoints listening on http://localhost:1234

Model load summary: Gemma 3 4b It, GGUF V3 Q4_K, model params ~3.88B

Offloaded 35/35 layers to GPU; Vulkan0 (Intel Arc A750) used

Memory breakdown shows Vulkan0 ~8080 MiB etc.

Final failure occurs shortly after "BeginProcessingPrompt" during predictTokens

Files / attachments
Please see and attach server logs: C:\Users\nazmu.lmstudio\server-logs (all files there).
Attach the full LM Studio output / stack trace (the llmworker.js dump) and model file name.

Additional helpful info (please include when reporting)

Exact LM Studio version (Help → About or executable properties)

GPU driver version and Vulkan runtime version (e.g., Intel driver version, Vulkan SDK/runtime)

Frequency: does this happen every run or intermittently? (I observed it during this run.)

Does reducing Num Offload Layers or switching off Vulkan offload avoid the issue?

Any GPU stress tests / other Vulkan apps succeed on this machine?

Possible guesses / hints

Could be Intel driver or Vulkan runtime issue causing device lost under compute load.

Could relate to timing/timeouts in fence polling when offloading many layers.

Might reproduce with large context / when offloading many layers to GPU.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions