Error: llama runner process has terminated: error loading model: No device of requested type available

[fanlessfan]

Hello,

I exactly followed the instruction below to try to run Ollama on my iGPU of i7-13700K, but got error when I run the ./ollama run llama3.1:8b.

https://github.com/intel-analytics/ipex-llm/blob/main/docs/mddocs/Quickstart/ollama_quickstart.md

here are the output from Ollama serve before and after ollama run.

does anyone can help?

(ollama) llm@fanlessLinux:~$ hwinfo --display
27: PCI 02.0: 0300 VGA compatible controller (VGA)
[Created at pci.386]
Unique ID: _Znp.iTfrQPXqtxB
SysFS ID: /devices/pci0000:00/0000:00:02.0
SysFS BusID: 0000:00:02.0
Hardware Class: graphics card
Device Name: "Onboard - Video"
Model: "Intel VGA compatible controller"
Vendor: pci 0x8086 "Intel Corporation"
Device: pci 0xa780
SubVendor: pci 0x1458 "Gigabyte Technology Co., Ltd"
SubDevice: pci 0xd000
Revision: 0x04
Driver: "i915"
Driver Modules: "i915"
Memory Range: 0x6002000000-0x6002ffffff (rw,non-prefetchable)
Memory Range: 0x4000000000-0x403fffffff (ro,non-prefetchable)
I/O Ports: 0x5000-0x503f (rw)
Memory Range: 0x000c0000-0x000dffff (rw,non-prefetchable,disabled)
IRQ: 220 (11520 events)
Module Alias: "pci:v00008086d0000A780sv00001458sd0000D000bc03sc00i00"
Driver Info #0:
Driver Status: i915 is active
Driver Activation Cmd: "modprobe i915"
Config Status: cfg=new, avail=yes, need=no, active=unknown

Primary display adapter: #27

sudo dmesg | grep i915
[ 8.042895] i915 0000:00:02.0: Using 24 cores (0-23) for kthreads
[ 8.043501] i915 0000:00:02.0: vgaarb: deactivate vga console
[ 8.043512] i915 0000:00:02.0: Using Transparent Hugepages
[ 8.053594] i915 0000:00:02.0: [drm] Finished loading DMC firmware i915/adls_dmc_ver2_01.bin (v2.1)
[ 8.085845] i915 0000:00:02.0: [drm] Protected Xe Path (PXP) protected content support initialized
[ 8.085848] i915 0000:00:02.0: GT0: GuC firmware i915/tgl_guc_70.26.4.bin version 70.26.4
[ 8.085851] i915 0000:00:02.0: GT0: HuC firmware i915/tgl_huc_7.9.3.bin version 7.9.3
[ 8.118088] [drm] Initialized i915 1.6.0 20201103 for 0000:00:02.0 on minor 0
[ 8.152002] snd_hda_intel 0000:00:1f.3: bound 0000:00:02.0 (ops i915_audio_component_bind_ops [i915])

==========ollama serve output========
time=2024-11-20T15:05:56.394-05:00 level=INFO source=payload.go:44 msg="Dynamic LLM libraries [cpu cpu_avx cpu_avx2]". <== does this mean gpu was not recognized?
[GIN] 2024/11/20 - 15:06:09 | 200 | 82.264µs | 127.0.0.1 | HEAD "/"
[GIN] 2024/11/20 - 15:06:09 | 200 | 19.279993ms | 127.0.0.1 | POST "/api/show"

#########
ollama run from here
#########

time=2024-11-20T15:06:09.925-05:00 level=INFO source=gpu.go:168 msg="looking for compatible GPUs"
time=2024-11-20T15:06:09.925-05:00 level=WARN source=gpu.go:560 msg="unable to locate gpu dependency libraries" <== this might be the real reason.
time=2024-11-20T15:06:09.925-05:00 level=WARN source=gpu.go:560 msg="unable to locate gpu dependency libraries"
time=2024-11-20T15:06:09.928-05:00 level=WARN source=gpu.go:560 msg="unable to locate gpu dependency libraries"
time=2024-11-20T15:06:09.929-05:00 level=INFO source=gpu.go:280 msg="no compatible GPUs were discovered"
time=2024-11-20T15:06:09.952-05:00 level=INFO source=memory.go:309 msg="offload to cpu" layers.requested=-1 layers.model=33 layers.offload=0 layers.split="" memory.available="[91.5 GiB]" memory.required.full="5.8 GiB" memory.required.partial="0 B" memory.required.kv="1.0 GiB" memory.required.allocations="[5.8 GiB]" memory.weights.total="4.7 GiB" memory.weights.repeating="4.3 GiB" memory.weights.nonrepeating="411.0 MiB" memory.graph.full="560.0 MiB" memory.graph.partial="677.5 MiB"
time=2024-11-20T15:06:09.953-05:00 level=INFO source=server.go:395 msg="starting llama server" cmd="/tmp/ollama829815146/runners/cpu_avx2/ollama_llama_server --model /home/llm/.ollama/models/blobs/sha256-8eeb52dfb3bb9aefdf9d1ef24b3bdbcfbe82238798c4b918278320b6fcef18fe --ctx-size 8192 --batch-size 512 --embedding --log-disable --n-gpu-layers 999 --no-mmap --parallel 4 --port 41231"

[fanlessfan]

how do I know if my iGPU driver installed properly?

[fanlessfan]

for some reason I make it work once, at that time I want to compare the performance or CPU and GPU, so I installed the regular ollama and broke the GPU version. after that I re-installed the Ubuntu, but never make it work again.

[sgwhat]

Hi @fanlessfan, msg="Dynamic LLM libraries [cpu cpu_avx cpu_avx2]" does not mean that the iGPU was not recognized. If your iGPU is installed correctly, you will see the following log when ollama serve is running:

found 1 SYCL devices:
|  |                   |                                       |       |Max    |        |Max  |Global |                     |
|  |                   |                                       |       |compute|Max work|sub  |mem    |                     |
|ID|        Device Type|                                   Name|Version|units  |group   |group|size   |       Driver version|
|--|-------------------|---------------------------------------|-------|-------|--------|-----|-------|---------------------|
| 0| [level_zero:gpu:0]|                     Intel Arc Graphics|    1.3|    112|    1024|   32| 13578M|            1.3.27504|

[fanlessfan]

Thank you @sgwhat Here is my output from ollama serve. there is no found 1 SYCL devices. Could you help me to check what's wrong?

thx again.

(ollama) llm@fanlessLinux:~$ ./oserve

:: initializing oneAPI environment ...
oserve: BASH_VERSION = 5.1.16(1)-release
args: Using "$@" for setvars.sh arguments:
:: ccl -- latest
:: compiler -- latest
:: dal -- latest
:: debugger -- latest
:: dev-utilities -- latest
:: dnnl -- latest
:: dpcpp-ct -- latest
:: dpl -- latest
:: ipp -- latest
:: ippcp -- latest
:: mkl -- latest
:: mpi -- latest
:: tbb -- latest
:: oneAPI environment initialized ::

2024/11/21 08:29:25 routes.go:1125: INFO server config env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: OLLAMA_DEBUG:false OLLAMA_FLASH_ATTENTION:false OLLAMA_HOST:http://127.0.0.1:11434 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:5m0s OLLAMA_LLM_LIBRARY: OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/home/llm/.ollama/models OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:0 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://*] OLLAMA_RUNNERS_DIR: OLLAMA_SCHED_SPREAD:false OLLAMA_TMPDIR: ROCR_VISIBLE_DEVICES:]"
time=2024-11-21T08:29:25.606-05:00 level=INFO source=images.go:753 msg="total blobs: 10"
time=2024-11-21T08:29:25.607-05:00 level=INFO source=images.go:760 msg="total unused blobs removed: 0"
[GIN-debug] [WARNING] Creating an Engine instance with the Logger and Recovery middleware already attached.

[GIN-debug] [WARNING] Running in "debug" mode. Switch to "release" mode in production.

• using env: export GIN_MODE=release
• using code: gin.SetMode(gin.ReleaseMode)

[GIN-debug] POST /api/pull --> github.com/ollama/ollama/server.(*Server).PullModelHandler-fm (5 handlers)
[GIN-debug] POST /api/generate --> github.com/ollama/ollama/server.(*Server).GenerateHandler-fm (5 handlers)
[GIN-debug] POST /api/chat --> github.com/ollama/ollama/server.(*Server).ChatHandler-fm (5 handlers)
[GIN-debug] POST /api/embed --> github.com/ollama/ollama/server.(*Server).EmbedHandler-fm (5 handlers)
[GIN-debug] POST /api/embeddings --> github.com/ollama/ollama/server.(*Server).EmbeddingsHandler-fm (5 handlers)
[GIN-debug] POST /api/create --> github.com/ollama/ollama/server.(*Server).CreateModelHandler-fm (5 handlers)
[GIN-debug] POST /api/push --> github.com/ollama/ollama/server.(*Server).PushModelHandler-fm (5 handlers)
[GIN-debug] POST /api/copy --> github.com/ollama/ollama/server.(*Server).CopyModelHandler-fm (5 handlers)
[GIN-debug] DELETE /api/delete --> github.com/ollama/ollama/server.(*Server).DeleteModelHandler-fm (5 handlers)
[GIN-debug] POST /api/show --> github.com/ollama/ollama/server.(*Server).ShowModelHandler-fm (5 handlers)
[GIN-debug] POST /api/blobs/:digest --> github.com/ollama/ollama/server.(*Server).CreateBlobHandler-fm (5 handlers)
[GIN-debug] HEAD /api/blobs/:digest --> github.com/ollama/ollama/server.(*Server).HeadBlobHandler-fm (5 handlers)
[GIN-debug] GET /api/ps --> github.com/ollama/ollama/server.(*Server).ProcessHandler-fm (5 handlers)
[GIN-debug] POST /v1/chat/completions --> github.com/ollama/ollama/server.(*Server).ChatHandler-fm (6 handlers)
[GIN-debug] POST /v1/completions --> github.com/ollama/ollama/server.(*Server).GenerateHandler-fm (6 handlers)
[GIN-debug] POST /v1/embeddings --> github.com/ollama/ollama/server.(*Server).EmbedHandler-fm (6 handlers)
[GIN-debug] GET /v1/models --> github.com/ollama/ollama/server.(*Server).ListModelsHandler-fm (6 handlers)
[GIN-debug] GET /v1/models/:model --> github.com/ollama/ollama/server.(*Server).ShowModelHandler-fm (6 handlers)
[GIN-debug] GET / --> github.com/ollama/ollama/server.(*Server).GenerateRoutes.func1 (5 handlers)
[GIN-debug] GET /api/tags --> github.com/ollama/ollama/server.(*Server).ListModelsHandler-fm (5 handlers)
[GIN-debug] GET /api/version --> github.com/ollama/ollama/server.(*Server).GenerateRoutes.func2 (5 handlers)
[GIN-debug] HEAD / --> github.com/ollama/ollama/server.(*Server).GenerateRoutes.func1 (5 handlers)
[GIN-debug] HEAD /api/tags --> github.com/ollama/ollama/server.(*Server).ListModelsHandler-fm (5 handlers)
[GIN-debug] HEAD /api/version --> github.com/ollama/ollama/server.(*Server).GenerateRoutes.func2 (5 handlers)
time=2024-11-21T08:29:25.607-05:00 level=INFO source=routes.go:1172 msg="Listening on 127.0.0.1:11434 (version 0.3.6-ipexllm-20241120)"
time=2024-11-21T08:29:25.607-05:00 level=INFO source=payload.go:30 msg="extracting embedded files" dir=/tmp/ollama4121763755/runners
time=2024-11-21T08:29:25.688-05:00 level=INFO source=payload.go:44 msg="Dynamic LLM libraries [cpu cpu_avx cpu_avx2]"

[fanlessfan]

here is my hwinfo output

hwinfo --display
27: PCI 02.0: 0300 VGA compatible controller (VGA)
[Created at pci.386]
Unique ID: _Znp.iTfrQPXqtxB
SysFS ID: /devices/pci0000:00/0000:00:02.0
SysFS BusID: 0000:00:02.0
Hardware Class: graphics card
Device Name: "Onboard - Video"
Model: "Intel VGA compatible controller"
Vendor: pci 0x8086 "Intel Corporation"
Device: pci 0xa780
SubVendor: pci 0x1458 "Gigabyte Technology Co., Ltd"
SubDevice: pci 0xd000
Revision: 0x04
Driver: "i915"
Driver Modules: "i915"
Memory Range: 0x6002000000-0x6002ffffff (rw,non-prefetchable)
Memory Range: 0x4000000000-0x403fffffff (ro,non-prefetchable)
I/O Ports: 0x5000-0x503f (rw)
Memory Range: 0x000c0000-0x000dffff (rw,non-prefetchable,disabled)
IRQ: 220 (91 events)
Module Alias: "pci:v00008086d0000A780sv00001458sd0000D000bc03sc00i00"
Driver Info #0:
Driver Status: i915 is active
Driver Activation Cmd: "modprobe i915"
Config Status: cfg=new, avail=yes, need=no, active=unknown

[sgwhat]

Hi @fanlessfan，these SYCL devices will only be recognized when a model is running with ollama serve. Could you please show the complete log when you run ollama run llama3.1?

[fanlessfan]

Hi @sgwhat Here is the full log when I run ollama run

time=2024-11-22T15:39:35.952-05:00 level=INFO source=payload.go:44 msg="Dynamic LLM libraries [cpu cpu_avx cpu_avx2]"
[GIN] 2024/11/22 - 15:41:15 | 200 | 119.008µs | 127.0.0.1 | HEAD "/"
[GIN] 2024/11/22 - 15:41:15 | 200 | 959.6µs | 127.0.0.1 | GET "/api/tags"
[GIN] 2024/11/22 - 15:41:36 | 200 | 42.739µs | 127.0.0.1 | HEAD "/"
[GIN] 2024/11/22 - 15:41:36 | 200 | 26.475232ms | 127.0.0.1 | POST "/api/show"
time=2024-11-22T15:41:36.991-05:00 level=INFO source=gpu.go:168 msg="looking for compatible GPUs"
time=2024-11-22T15:41:36.991-05:00 level=WARN source=gpu.go:560 msg="unable to locate gpu dependency libraries"
time=2024-11-22T15:41:36.991-05:00 level=WARN source=gpu.go:560 msg="unable to locate gpu dependency libraries"
time=2024-11-22T15:41:36.996-05:00 level=WARN source=gpu.go:560 msg="unable to locate gpu dependency libraries"
time=2024-11-22T15:41:36.998-05:00 level=INFO source=gpu.go:280 msg="no compatible GPUs were discovered"
time=2024-11-22T15:41:37.029-05:00 level=INFO source=memory.go:309 msg="offload to cpu" layers.requested=-1 layers.model=33 layers.offload=0 layers.split="" memory.available="[92.0 GiB]" memory.required.full="5.8 GiB" memory.required.partial="0 B" memory.required.kv="1.0 GiB" memory.required.allocations="[5.8 GiB]" memory.weights.total="4.7 GiB" memory.weights.repeating="4.3 GiB" memory.weights.nonrepeating="411.0 MiB" memory.graph.full="560.0 MiB" memory.graph.partial="677.5 MiB"
time=2024-11-22T15:41:37.030-05:00 level=INFO source=server.go:395 msg="starting llama server" cmd="/tmp/ollama949964813/runners/cpu_avx2/ollama_llama_server --model /home/llm/.ollama/models/blobs/sha256-8eeb52dfb3bb9aefdf9d1ef24b3bdbcfbe82238798c4b918278320b6fcef18fe --ctx-size 8192 --batch-size 512 --embedding --log-disable --n-gpu-layers 999 --no-mmap --parallel 4 --port 37497"
time=2024-11-22T15:41:37.030-05:00 level=INFO source=sched.go:450 msg="loaded runners" count=1
time=2024-11-22T15:41:37.030-05:00 level=INFO source=server.go:595 msg="waiting for llama runner to start responding"
time=2024-11-22T15:41:37.030-05:00 level=INFO source=server.go:629 msg="waiting for server to become available" status="llm server error"
INFO [main] build info | build=1 commit="487f188" tid="129993675795456" timestamp=1732308097
INFO [main] system info | n_threads=8 n_threads_batch=-1 system_info="AVX = 0 | AVX_VNNI = 0 | AVX2 = 0 | AVX512 = 0 | AVX512_VBMI = 0 | AVX512_VNNI = 0 | AVX512_BF16 = 0 | FMA = 0 | NEON = 0 | SVE = 0 | ARM_FMA = 0 | F16C = 0 | FP16_VA = 0 | WASM_SIMD = 0 | BLAS = 1 | SSE3 = 0 | SSSE3 = 0 | VSX = 0 | MATMUL_INT8 = 0 | LLAMAFILE = 1 | " tid="129993675795456" timestamp=1732308097 total_threads=24
INFO [main] HTTP server listening | hostname="127.0.0.1" n_threads_http="23" port="37497" tid="129993675795456" timestamp=1732308097
time=2024-11-22T15:41:37.281-05:00 level=INFO source=server.go:629 msg="waiting for server to become available" status="llm server loading model"
llama_model_loader: loaded meta data with 29 key-value pairs and 292 tensors from /home/llm/.ollama/models/blobs/sha256-8eeb52dfb3bb9aefdf9d1ef24b3bdbcfbe82238798c4b918278320b6fcef18fe (version GGUF V3 (latest))
llama_model_loader: Dumping metadata keys/values. Note: KV overrides do not apply in this output.
llama_model_loader: - kv 0: general.architecture str = llama
llama_model_loader: - kv 1: general.type str = model
llama_model_loader: - kv 2: general.name str = Meta Llama 3.1 8B Instruct
llama_model_loader: - kv 3: general.finetune str = Instruct
llama_model_loader: - kv 4: general.basename str = Meta-Llama-3.1
llama_model_loader: - kv 5: general.size_label str = 8B
llama_model_loader: - kv 6: general.license str = llama3.1
llama_model_loader: - kv 7: general.tags arr[str,6] = ["facebook", "meta", "pytorch", "llam...
llama_model_loader: - kv 8: general.languages arr[str,8] = ["en", "de", "fr", "it", "pt", "hi", ...
llama_model_loader: - kv 9: llama.block_count u32 = 32
llama_model_loader: - kv 10: llama.context_length u32 = 131072
llama_model_loader: - kv 11: llama.embedding_length u32 = 4096
llama_model_loader: - kv 12: llama.feed_forward_length u32 = 14336
llama_model_loader: - kv 13: llama.attention.head_count u32 = 32
llama_model_loader: - kv 14: llama.attention.head_count_kv u32 = 8
llama_model_loader: - kv 15: llama.rope.freq_base f32 = 500000.000000
llama_model_loader: - kv 16: llama.attention.layer_norm_rms_epsilon f32 = 0.000010
llama_model_loader: - kv 17: general.file_type u32 = 2
llama_model_loader: - kv 18: llama.vocab_size u32 = 128256
llama_model_loader: - kv 19: llama.rope.dimension_count u32 = 128
llama_model_loader: - kv 20: tokenizer.ggml.model str = gpt2
llama_model_loader: - kv 21: tokenizer.ggml.pre str = llama-bpe
llama_model_loader: - kv 22: tokenizer.ggml.tokens arr[str,128256] = ["!", """, "#", "$", "%", "&", "'", ...
llama_model_loader: - kv 23: tokenizer.ggml.token_type arr[i32,128256] = [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, ...
llama_model_loader: - kv 24: tokenizer.ggml.merges arr[str,280147] = ["Ġ Ġ", "Ġ ĠĠĠ", "ĠĠ ĠĠ", "...
llama_model_loader: - kv 25: tokenizer.ggml.bos_token_id u32 = 128000
llama_model_loader: - kv 26: tokenizer.ggml.eos_token_id u32 = 128009
llama_model_loader: - kv 27: tokenizer.chat_template str = {{- bos_token }}\n{%- if custom_tools ...
llama_model_loader: - kv 28: general.quantization_version u32 = 2
llama_model_loader: - type f32: 66 tensors
llama_model_loader: - type q4_0: 225 tensors
llama_model_loader: - type q6_K: 1 tensors
llm_load_vocab: special tokens cache size = 256
llm_load_vocab: token to piece cache size = 0.7999 MB
llm_load_print_meta: format = GGUF V3 (latest)
llm_load_print_meta: arch = llama
llm_load_print_meta: vocab type = BPE
llm_load_print_meta: n_vocab = 128256
llm_load_print_meta: n_merges = 280147
llm_load_print_meta: vocab_only = 0
llm_load_print_meta: n_ctx_train = 131072
llm_load_print_meta: n_embd = 4096
llm_load_print_meta: n_layer = 32
llm_load_print_meta: n_head = 32
llm_load_print_meta: n_head_kv = 8
llm_load_print_meta: n_rot = 128
llm_load_print_meta: n_swa = 0
llm_load_print_meta: n_embd_head_k = 128
llm_load_print_meta: n_embd_head_v = 128
llm_load_print_meta: n_gqa = 4
llm_load_print_meta: n_embd_k_gqa = 1024
llm_load_print_meta: n_embd_v_gqa = 1024
llm_load_print_meta: f_norm_eps = 0.0e+00
llm_load_print_meta: f_norm_rms_eps = 1.0e-05
llm_load_print_meta: f_clamp_kqv = 0.0e+00
llm_load_print_meta: f_max_alibi_bias = 0.0e+00
llm_load_print_meta: f_logit_scale = 0.0e+00
llm_load_print_meta: n_ff = 14336
llm_load_print_meta: n_expert = 0
llm_load_print_meta: n_expert_used = 0
llm_load_print_meta: causal attn = 1
llm_load_print_meta: pooling type = 0
llm_load_print_meta: rope type = 0
llm_load_print_meta: rope scaling = linear
llm_load_print_meta: freq_base_train = 500000.0
llm_load_print_meta: freq_scale_train = 1
llm_load_print_meta: n_ctx_orig_yarn = 131072
llm_load_print_meta: rope_finetuned = unknown
llm_load_print_meta: ssm_d_conv = 0
llm_load_print_meta: ssm_d_inner = 0
llm_load_print_meta: ssm_d_state = 0
llm_load_print_meta: ssm_dt_rank = 0
llm_load_print_meta: ssm_dt_b_c_rms = 0
llm_load_print_meta: model type = 8B
llm_load_print_meta: model ftype = Q4_0
llm_load_print_meta: model params = 8.03 B
llm_load_print_meta: model size = 4.33 GiB (4.64 BPW)
llm_load_print_meta: general.name = Meta Llama 3.1 8B Instruct
llm_load_print_meta: BOS token = 128000 '<|begin_of_text|>'
llm_load_print_meta: EOS token = 128009 '<|eot_id|>'
llm_load_print_meta: LF token = 128 'Ä'
llm_load_print_meta: EOT token = 128009 '<|eot_id|>'
llm_load_print_meta: EOM token = 128008 '<|eom_id|>'
llm_load_print_meta: EOG token = 128008 '<|eom_id|>'
llm_load_print_meta: EOG token = 128009 '<|eot_id|>'
llm_load_print_meta: max token length = 256
llama_model_load: error loading model: No device of requested type available. Please check https://software.intel.com/content/www/us/en/develop/articles/intel-oneapi-dpcpp-system-requirements.html -1 (PI_ERROR_DEVICE_NOT_FOUND)
llama_load_model_from_file: exception loading model
terminate called after throwing an instance of 'sycl::_V1::runtime_error'
what(): No device of requested type available. Please check https://software.intel.com/content/www/us/en/develop/articles/intel-oneapi-dpcpp-system-requirements.html -1 (PI_ERROR_DEVICE_NOT_FOUND)
time=2024-11-22T15:41:37.783-05:00 level=ERROR source=sched.go:456 msg="error loading llama server" error="llama runner process has terminated: error loading model: No device of requested type available. Please check https://software.intel.com/content/www/us/en/develop/articles/intel-oneapi-dpcpp-system-requirements.html -1 (PI_ERROR_DEVICE_NOT_FOUND)\nllama_load_model_from_file: exception loading model"
[GIN] 2024/11/22 - 15:41:37 | 500 | 808.546284ms | 127.0.0.1 | POST "/api/chat"

[fanlessfan]

Is the logs below means it didn't recognize the iGPU? but the hwinfo shows my iGPU and I followed the instructions step by step for several times.

Thanks in advance

time=2024-11-22T15:41:36.991-05:00 level=INFO source=gpu.go:168 msg="looking for compatible GPUs"
time=2024-11-22T15:41:36.991-05:00 level=WARN source=gpu.go:560 msg="unable to locate gpu dependency libraries"
time=2024-11-22T15:41:36.991-05:00 level=WARN source=gpu.go:560 msg="unable to locate gpu dependency libraries"
time=2024-11-22T15:41:36.996-05:00 level=WARN source=gpu.go:560 msg="unable to locate gpu dependency libraries"
time=2024-11-22T15:41:36.998-05:00 level=INFO source=gpu.go:280 msg="no compatible GPUs were discovered"

hwinfo --display
27: PCI 02.0: 0300 VGA compatible controller (VGA)
[Created at pci.386]
Unique ID: _Znp.iTfrQPXqtxB
SysFS ID: /devices/pci0000:00/0000:00:02.0
SysFS BusID: 0000:00:02.0
Hardware Class: graphics card
Device Name: "Onboard - Video"
Model: "Intel VGA compatible controller"
Vendor: pci 0x8086 "Intel Corporation"
Device: pci 0xa780
SubVendor: pci 0x1458 "Gigabyte Technology Co., Ltd"
SubDevice: pci 0xd000
Revision: 0x04
Driver: "i915"
Driver Modules: "i915"
Memory Range: 0x6002000000-0x6002ffffff (rw,non-prefetchable)
Memory Range: 0x4000000000-0x403fffffff (ro,non-prefetchable)
I/O Ports: 0x5000-0x503f (rw)
Memory Range: 0x000c0000-0x000dffff (rw,non-prefetchable,disabled)
IRQ: 220 (1624 events)
Module Alias: "pci:v00008086d0000A780sv00001458sd0000D000bc03sc00i00"
Driver Info #0:
Driver Status: i915 is active
Driver Activation Cmd: "modprobe i915"
Config Status: cfg=new, avail=yes, need=no, active=unknown

Primary display adapter: #27

[sgwhat]

hi @fanlessfan, I think this is because your iGPU driver was not installed correctly. Please refer to install_linux_gpu to reinstall it.

[fanlessfan]

Hello @sgwhat , I followed the exact instruction several times to install the driver and every time I also re-installed the OS. from the instruction, it show the command to verify the installation. and every time my output seems correct.

Is there any other way to verify the iGPU driver?

thx

Verify the device is working with i915 driver

sudo apt-get install -y hwinfo
hwinfo --display

27: PCI 02.0: 0300 VGA compatible controller (VGA)
[Created at pci.386]
Unique ID: _Znp.iTfrQPXqtxB
SysFS ID: /devices/pci0000:00/0000:00:02.0
SysFS BusID: 0000:00:02.0
Hardware Class: graphics card
Device Name: "Onboard - Video"
Model: "Intel VGA compatible controller"
Vendor: pci 0x8086 "Intel Corporation"
Device: pci 0xa780
SubVendor: pci 0x1458 "Gigabyte Technology Co., Ltd"
SubDevice: pci 0xd000
Revision: 0x04
Driver: "i915"
Driver Modules: "i915"
Memory Range: 0x6002000000-0x6002ffffff (rw,non-prefetchable)
Memory Range: 0x4000000000-0x403fffffff (ro,non-prefetchable)
I/O Ports: 0x5000-0x503f (rw)
Memory Range: 0x000c0000-0x000dffff (rw,non-prefetchable,disabled)
IRQ: 220 (1624 events)
Module Alias: "pci:v00008086d0000A780sv00001458sd0000D000bc03sc00i00"
Driver Info #0:
Driver Status: i915 is active
Driver Activation Cmd: "modprobe i915"
Config Status: cfg=new, avail=yes, need=no, active=unknown