Foundry-local pops errors on AMD device

[Panepo]

Execute foundry-local on powershell got the following error:

PS C:\WINDOWS\system32> foundry cache ls
Models cached on device:
   Alias                                             Model ID
[22:34:35 ERR] Failed to process model #0 on page 1.
[22:34:35 ERR] Failed to process model #0 on page 1.
[22:34:35 ERR] Failed to process model #0 on page 1.
[22:34:35 ERR] Failed to process model #0 on page 1.
[22:34:36 ERR] Failed to process model #0 on page 2.
[22:34:36 ERR] Failed to process model #0 on page 2.
[22:34:36 ERR] Failed to process model #0 on page 2.
[22:34:36 ERR] Failed to process model #0 on page 2.
💾 phi-4-mini                                        Phi-4-mini-instruct-generic-gpu:5
💾 phi-4-mini                                        phi-4-mini-instruct-vitis-npu:2
PS C:\WINDOWS\system32> foundry model run phi-4-mini-instruct-vitis-npu:2
[22:34:53 ERR] Failed to process model #0 on page 1.
[22:34:53 ERR] Failed to process model #0 on page 1.
[22:34:53 ERR] Failed to process model #0 on page 1.
[22:34:53 ERR] Failed to process model #0 on page 1.
[22:34:54 ERR] Failed to process model #0 on page 2.
[22:34:54 ERR] Failed to process model #0 on page 2.
[22:34:54 ERR] Failed to process model #0 on page 2.
[22:34:54 ERR] Failed to process model #0 on page 2.
Model phi-4-mini-instruct-vitis-npu:2 was found in the local cache.
Unloading existing models. Use --retain true to keep additional models loaded.
🕔 Loading model... Exception: Request to local service failed. Uri:http://127.0.0.1:49308/openai/load/phi-4-mini-instruct-vitis-npu:2?ttl=600
An error occurred while sending the request.
Please check service status with 'foundry service status'.

Environment

Foundry-local version: 0.8.119
Windows version: 25H2 (OS Build 26300.8376)
Processor: AMD Radeon 860M

[bmehta001]

Hi @Panepo, Thanks for opening the issue. The Failed to process model #0 on page 1. error is expected for some older models, and can be ignored, but the fact that it is failing to process models on other pages is an issue.

Can you please run foundry service status and paste the output here? You can also run foundry service stop and then foundry service start to restart the backend, then try again.

[Panepo]

Hi @bmehta001, Here's the results:

C:\Windows\System32>foundry model load phi-4-mini-instruct-vitis-npu:2
[18:32:39 ERR] Failed to process model #0 on page 1.
[18:32:39 ERR] Failed to process model #0 on page 1.
[18:32:39 ERR] Failed to process model #0 on page 1.
[18:32:39 ERR] Failed to process model #0 on page 1.
[18:32:40 ERR] Failed to process model #0 on page 2.
[18:32:40 ERR] Failed to process model #0 on page 2.
[18:32:40 ERR] Failed to process model #0 on page 2.
[18:32:40 ERR] Failed to process model #0 on page 2.
🕖 Loading model... Exception: Request to local service failed. Uri:http://127.0.0.1:62264/openai/load/phi-4-mini-instruct-vitis-npu:2?ttl=600
An error occurred while sending the request.
Please check service status with 'foundry service status'.

C:\Windows\System32>foundry service status
🔴 Model management service is not running!
To start the service, run the following command: foundry service start

C:\Windows\System32>foundry service stop
🔴 Service is stopped.

C:\Windows\System32>foundry service start
🟢 Service is Started on http://127.0.0.1:62291/, PID 6904!

C:\Windows\System32>foundry model load phi-4-mini-instruct-vitis-npu:2
[18:33:06 ERR] Failed to process model #0 on page 1.
[18:33:06 ERR] Failed to process model #0 on page 1.
[18:33:06 ERR] Failed to process model #0 on page 1.
[18:33:06 ERR] Failed to process model #0 on page 1.
[18:33:06 ERR] Failed to process model #0 on page 2.
[18:33:06 ERR] Failed to process model #0 on page 2.
[18:33:06 ERR] Failed to process model #0 on page 2.
[18:33:06 ERR] Failed to process model #0 on page 2.
🕒 Loading model... Exception: Request to local service failed. Uri:http://127.0.0.1:62291/openai/load/phi-4-mini-instruct-vitis-npu:2?ttl=600
An error occurred while sending the request.
Please check service status with 'foundry service status'.

C:\Windows\System32>foundry service status
🔴 Model management service is not running!
To start the service, run the following command: foundry service start

[bmehta001]

Hi @Panepo, Thanks.

Can you please check the latest service logs under ~\.aitk\ and latest Foundry Local CLI logs under ~\.foundry\logs, and attach/paste them here? There may be an error listed there.

[davidrrowley]

I think a similar issue on a Windows 11 Intel Based device with NPU & GPU, installed foundry yesterday get the error when also running foundry model list command, though my service can start and stop fine as you can see below - happy to provide logs if it helps pind down the model#0 on page x errors.

🟢 Model management service is running on http://127.0.0.1:57839/openai/status
EP autoregistration status: Successfully downloaded and registered the following EPs: NvTensorRTRTXExecutionProvider, OpenVINOExecutionProvider, CUDAExecutionProvider.
Valid EPs: CPUExecutionProvider, WebGpuExecutionProvider, NvTensorRTRTXExecutionProvider, OpenVINOExecutionProvider, CUDAExecutionProvider

---

foundry cache ls

Models cached on device:
Alias Model ID
[09:40:19 ERR] Failed to process model #0 on page 1.
[09:40:19 ERR] Failed to process model #0 on page 1.
[09:40:19 ERR] Failed to process model #0 on page 1.
[09:40:19 ERR] Failed to process model #0 on page 1.
[09:40:20 ERR] Failed to process model #0 on page 2.
[09:40:20 ERR] Failed to process model #0 on page 2.
[09:40:20 ERR] Failed to process model #0 on page 3.
[09:40:20 ERR] Failed to process model #0 on page 3.
💾 phi-4-mini phi-4-mini-instruct-openvino-npu:3
💾 phi-4-mini-reasoning Phi-4-mini-reasoning-openvino-npu:3
💾 qwen2.5-coder-1.5b qwen2.5-coder-1.5b-instruct-openvino-npu:4

[Panepo]

Hi @bmehta001,

here are the logs:

20260521 063300-openai.service.log
foundry20260521.log

[bmehta001]

Hi @davidrrowley, Are you only seeing the "Failed to process model #0" issue? Or is foundry also crashing for you?

[bmehta001]

Hi @Panepo, Is it possible to send me the past several logs from~/.aitk? A new log file is created every time the service starts, but it crashed several times throughout the log file you sent from ~/.foundry, so I would like to see more log files. Also, if possible can you please uninstall Foundry Local CLI, delete ~/.foundry, then re-install Foundry Local CLI?

[davidrrowley]

@bmehta001 - yes, just the "Failed to process model #0" issue - the service starts and loads a cuda model for me (I have an AMD motherboard, but nVidia GPU).

Environment: Windows 11
Foundry version: 0.8.119
CPU: AMD Ryzen 9 5950X 16-Core Processor
GPU: RTX 3090Ti

`PowerShell 7.6.1
PS C:\Users\david> winget install Microsoft.FoundryLocal
Found Foundry Local [Microsoft.FoundryLocal] Version 0.8.119.102
This application is licensed to you by its owner.
Microsoft is not responsible for, nor does it grant any licenses to, third-party packages.
This package requires the following dependencies:
  - Packages
      Microsoft.VCLibs.Desktop.14 [>= 14.0.33728.0]
Successfully verified installer hash
Starting package install...
  ██████████████████████████████  100%
Successfully installed

PS C:\Users\david> foundry model list
🟢 Service is Started on http://127.0.0.1:59058/, PID 42948!
🕛 Downloading complete!...
Successfully downloaded and registered the following EPs: NvTensorRTRTXExecutionProvider, CUDAExecutionProvider.
Valid EPs: CPUExecutionProvider, WebGpuExecutionProvider, NvTensorRTRTXExecutionProvider, CUDAExecutionProvider
[14:08:42 ERR] Failed to process model #0 on page 1.
[14:08:42 ERR] Failed to process model #0 on page 1.
[14:08:42 ERR] Failed to process model #0 on page 1.
[14:08:42 ERR] Failed to process model #0 on page 1.
[14:08:42 ERR] Failed to process model #0 on page 2.
[14:08:42 ERR] Failed to process model #0 on page 2.
[14:08:42 ERR] Failed to process model #0 on page 2.
[14:08:42 ERR] Failed to process model #0 on page 2.
Alias                          Device     Task           File Size    License      Model ID
-----------------------------------------------------------------------------------------------
qwen2.5-coder-0.5b             GPU        chat           0.52 GB      MIT          qwen2.5-coder-0.5b-instruct-trtrtx-gpu:2
                               GPU        chat, tools    0.52 GB      apache-2.0   qwen2.5-coder-0.5b-instruct-cuda-gpu:4
                               GPU        chat, tools    0.52 GB      apache-2.0   qwen2.5-coder-0.5b-instruct-generic-gpu:4
                               CPU        chat, tools    0.80 GB      apache-2.0   qwen2.5-coder-0.5b-instruct-generic-cpu:4
--------------------------------------------------------------------------------------------------------------------------------
phi-4-mini-reasoning           GPU        chat           3.15 GB      MIT          Phi-4-mini-reasoning-cuda-gpu:3
                               GPU        chat           3.15 GB      MIT          Phi-4-mini-reasoning-generic-gpu:3
                               CPU        chat           4.52 GB      MIT          Phi-4-mini-reasoning-generic-cpu:3
-------------------------------------------------------------------------------------------------------------------------
qwen2.5-0.5b                   GPU        chat           0.52 GB      MIT          qwen2.5-0.5b-instruct-trtrtx-gpu:2
                               GPU        chat, tools    0.52 GB      apache-2.0   qwen2.5-0.5b-instruct-cuda-gpu:4
                               GPU        chat, tools    0.68 GB      apache-2.0   qwen2.5-0.5b-instruct-generic-gpu:4
                               CPU        chat, tools    0.80 GB      apache-2.0   qwen2.5-0.5b-instruct-generic-cpu:4
--------------------------------------------------------------------------------------------------------------------------
qwen2.5-1.5b                   GPU        chat           1.25 GB      MIT          qwen2.5-1.5b-instruct-trtrtx-gpu:2
                               GPU        chat, tools    1.25 GB      apache-2.0   qwen2.5-1.5b-instruct-cuda-gpu:4
                               GPU        chat, tools    1.51 GB      apache-2.0   qwen2.5-1.5b-instruct-generic-gpu:4
                               CPU        chat, tools    1.78 GB      apache-2.0   qwen2.5-1.5b-instruct-generic-cpu:4
--------------------------------------------------------------------------------------------------------------------------
qwen2.5-coder-1.5b             GPU        chat           1.25 GB      MIT          qwen2.5-coder-1.5b-instruct-trtrtx-gpu:2
                               GPU        chat, tools    1.25 GB      apache-2.0   qwen2.5-coder-1.5b-instruct-cuda-gpu:4
                               GPU        chat, tools    1.25 GB      apache-2.0   qwen2.5-coder-1.5b-instruct-generic-gpu:4
                               CPU        chat, tools    1.78 GB      apache-2.0   qwen2.5-coder-1.5b-instruct-generic-cpu:4
--------------------------------------------------------------------------------------------------------------------------------
phi-4-mini                     GPU        chat, tools    3.60 GB      MIT          Phi-4-mini-instruct-cuda-gpu:5
                               GPU        chat, tools    3.72 GB      MIT          Phi-4-mini-instruct-generic-gpu:5
                               CPU        chat, tools    4.80 GB      MIT          Phi-4-mini-instruct-generic-cpu:5
------------------------------------------------------------------------------------------------------------------------
qwen2.5-14b                    GPU        chat           8.79 GB      MIT          qwen2.5-14b-instruct-trtrtx-gpu:2
                               GPU        chat, tools    8.79 GB      apache-2.0   qwen2.5-14b-instruct-cuda-gpu:4
                               GPU        chat, tools    9.30 GB      apache-2.0   qwen2.5-14b-instruct-generic-gpu:4
                               CPU        chat, tools    11.06 GB     apache-2.0   qwen2.5-14b-instruct-generic-cpu:4
-------------------------------------------------------------------------------------------------------------------------
qwen2.5-coder-14b              GPU        chat           8.79 GB      MIT          qwen2.5-coder-14b-instruct-trtrtx-gpu:2
                               GPU        chat, tools    8.79 GB      apache-2.0   qwen2.5-coder-14b-instruct-cuda-gpu:4
                               GPU        chat, tools    8.79 GB      apache-2.0   qwen2.5-coder-14b-instruct-generic-gpu:4
                               CPU        chat, tools    11.06 GB     apache-2.0   qwen2.5-coder-14b-instruct-generic-cpu:4
-------------------------------------------------------------------------------------------------------------------------------
qwen2.5-coder-7b               GPU        chat           4.73 GB      MIT          qwen2.5-coder-7b-instruct-trtrtx-gpu:2
                               GPU        chat, tools    4.73 GB      apache-2.0   qwen2.5-coder-7b-instruct-cuda-gpu:4
                               GPU        chat, tools    4.73 GB      apache-2.0   qwen2.5-coder-7b-instruct-generic-gpu:4
                               CPU        chat, tools    6.16 GB      apache-2.0   qwen2.5-coder-7b-instruct-generic-cpu:4
------------------------------------------------------------------------------------------------------------------------------
qwen2.5-7b                     GPU        chat           5.49 GB      MIT          qwen2.5-7b-instruct-trtrtx-gpu:2
                               GPU        chat, tools    4.73 GB      apache-2.0   qwen2.5-7b-instruct-cuda-gpu:4
                               GPU        chat, tools    5.20 GB      apache-2.0   qwen2.5-7b-instruct-generic-gpu:4
                               CPU        chat, tools    6.16 GB      apache-2.0   qwen2.5-7b-instruct-generic-cpu:4
------------------------------------------------------------------------------------------------------------------------
gpt-oss-20b                    CPU        chat           12.26 GB     MIT          gpt-oss-20b-generic-cpu:1
                               GPU        chat           9.65 GB      apache-2.0   gpt-oss-20b-cuda-gpu:1
                               GPU        chat           11.78 GB     MIT          gpt-oss-20b-generic-gpu:1
----------------------------------------------------------------------------------------------------------------
phi-3-mini-128k                GPU        chat           2.13 GB      MIT          phi-3-mini-128k-instruct-trtrtx-gpu:2
                               GPU        chat           2.13 GB      MIT          Phi-3-mini-128k-instruct-cuda-gpu:2
                               GPU        chat           2.13 GB      MIT          Phi-3-mini-128k-instruct-generic-gpu:2
                               CPU        chat           2.54 GB      MIT          Phi-3-mini-128k-instruct-generic-cpu:3
-----------------------------------------------------------------------------------------------------------------------------
phi-3.5-mini                   GPU        chat           2.13 GB      MIT          phi-3.5-mini-instruct-trtrtx-gpu:2
                               GPU        chat           2.13 GB      MIT          Phi-3.5-mini-instruct-cuda-gpu:2
                               GPU        chat           2.16 GB      MIT          Phi-3.5-mini-instruct-generic-gpu:2
                               CPU        chat           2.53 GB      MIT          Phi-3.5-mini-instruct-generic-cpu:2
--------------------------------------------------------------------------------------------------------------------------
phi-4                          GPU        chat           8.37 GB      MIT          Phi-4-trtrtx-gpu:2
                               GPU        chat           8.37 GB      MIT          Phi-4-cuda-gpu:2
                               GPU        chat           8.37 GB      MIT          Phi-4-generic-gpu:2
                               CPU        chat           10.16 GB     MIT          Phi-4-generic-cpu:2
----------------------------------------------------------------------------------------------------------
deepseek-r1-7b                 GPU        chat           5.28 GB      MIT          deepseek-r1-distill-qwen-7b-cuda-gpu:4
                               GPU        chat           5.58 GB      MIT          deepseek-r1-distill-qwen-7b-generic-gpu:4
                               CPU        chat           6.43 GB      MIT          deepseek-r1-distill-qwen-7b-generic-cpu:4
                               GPU        chat           5.28 GB      MIT          DeepSeek-R1-Distill-Qwen-7B-trtrtx-gpu:2
-------------------------------------------------------------------------------------------------------------------------------
phi-3-mini-4k                  GPU        chat           2.13 GB      MIT          phi-3-mini-4k-instruct-trtrtx-gpu:2
                               GPU        chat           2.13 GB      MIT          Phi-3-mini-4k-instruct-cuda-gpu:2
                               GPU        chat           2.13 GB      MIT          Phi-3-mini-4k-instruct-generic-gpu:2
                               CPU        chat           2.53 GB      MIT          Phi-3-mini-4k-instruct-generic-cpu:3
---------------------------------------------------------------------------------------------------------------------------
mistral-7b-v0.2                GPU        chat           3.98 GB      Apache-2.0   mistralai-Mistral-7B-Instruct-v0-2-trtrtx-gpu:2
                               GPU        chat           3.98 GB      apache-2.0   mistralai-Mistral-7B-Instruct-v0-2-cuda-gpu:2
                               GPU        chat           4.07 GB      apache-2.0   mistralai-Mistral-7B-Instruct-v0-2-generic-gpu:2
                               CPU        chat           4.07 GB      apache-2.0   mistralai-Mistral-7B-Instruct-v0-2-generic-cpu:3
---------------------------------------------------------------------------------------------------------------------------------------
deepseek-r1-14b                GPU        chat           9.83 GB      MIT          deepseek-r1-distill-qwen-14b-trtrtx-gpu:2
                               GPU        chat           9.83 GB      MIT          deepseek-r1-distill-qwen-14b-cuda-gpu:4
                               GPU        chat           10.27 GB     MIT          deepseek-r1-distill-qwen-14b-generic-gpu:4
                               CPU        chat           11.51 GB     MIT          deepseek-r1-distill-qwen-14b-generic-cpu:4
---------------------------------------------------------------------------------------------------------------------------------
qwen3-vl-4b-instruct           GPU        vision-language-chat, tools 3.48 GB      apache-2.0   qwen3-vl-4b-instruct-cuda-gpu:2
                               CPU        vision-language-chat, tools 2.73 GB      apache-2.0   qwen3-vl-4b-instruct-generic-cpu:3
                               CPU        vision-language-chat, tools 2.73 GB      apache-2.0   QWEN3-VL-4B-INSTRUCT-GENERIC-CPU:2
-------------------------------------------------------------------------------------------------------------------------
qwen3-14b                      GPU        chat, tools    9.08 GB      apache-2.0   qwen3-14b-cuda-gpu:2
                               GPU        chat, tools    9.93 GB      apache-2.0   qwen3-14b-generic-gpu:2
                               CPU        chat, tools    9.31 GB      apache-2.0   qwen3-14b-generic-cpu:2
--------------------------------------------------------------------------------------------------------------
qwen3-1.7b                     GPU        chat, tools    1.29 GB      apache-2.0   qwen3-1.7b-cuda-gpu:2
                               GPU        chat, tools    1.39 GB      apache-2.0   qwen3-1.7b-generic-gpu:2
                               CPU        chat, tools    1.32 GB      apache-2.0   qwen3-1.7b-generic-cpu:2
---------------------------------------------------------------------------------------------------------------
qwen3-vl-2b-instruct           GPU        vision-language-chat, tools 2.11 GB      apache-2.0   qwen3-vl-2b-instruct-cuda-gpu:2
                               CPU        vision-language-chat, tools 1.34 GB      apache-2.0   qwen3-vl-2b-instruct-generic-cpu:2
-------------------------------------------------------------------------------------------------------------------------
qwen3-4b                       GPU        chat, tools    2.63 GB      apache-2.0   qwen3-4b-cuda-gpu:2
                               GPU        chat, tools    2.87 GB      apache-2.0   qwen3-4b-generic-gpu:2
                               CPU        chat, tools    2.70 GB      apache-2.0   qwen3-4b-generic-cpu:3
-------------------------------------------------------------------------------------------------------------
qwen3-0.6b                     GPU        chat, tools    0.48 GB      apache-2.0   qwen3-0.6b-cuda-gpu:2
                               GPU        chat, tools    0.52 GB      apache-2.0   qwen3-0.6b-generic-gpu:2
                               CPU        chat, tools    0.58 GB      apache-2.0   qwen3-0.6b-generic-cpu:4
---------------------------------------------------------------------------------------------------------------
qwen3-8b                       GPU        chat, tools    5.54 GB      apache-2.0   qwen3-8b-cuda-gpu:2
                               GPU        chat, tools    6.00 GB      apache-2.0   qwen3-8b-generic-gpu:2
                               CPU        chat, tools    5.67 GB      apache-2.0   qwen3-8b-generic-cpu:2
-------------------------------------------------------------------------------------------------------------
qwen3-vl-8b-instruct           GPU        vision-language-chat, tools 5.99 GB      apache-2.0   qwen3-vl-8b-instruct-cuda-gpu:2
                               CPU        vision-language-chat, tools 4.96 GB      apache-2.0   qwen3-vl-8b-instruct-generic-cpu:2
-------------------------------------------------------------------------------------------------------------------------
qwen3.5-0.8b                   GPU        vision-language-chat, tools 1.32 GB      apache-2.0   qwen3.5-0.8b-cuda-gpu:2
                               GPU        vision-language-chat, tools 1.31 GB      apache-2.0   qwen3.5-0.8b-generic-gpu:2
                               CPU        vision-language-chat, tools 0.88 GB      apache-2.0   qwen3.5-0.8b-generic-cpu:2
-----------------------------------------------------------------------------------------------------------------
qwen3.5-2b                     GPU        vision-language-chat, tools 3.13 GB      apache-2.0   qwen3.5-2b-cuda-gpu:2
                               GPU        vision-language-chat, tools 3.13 GB      apache-2.0   qwen3.5-2b-generic-gpu:2
                               CPU        vision-language-chat, tools 2.10 GB      apache-2.0   qwen3.5-2b-generic-cpu:2
---------------------------------------------------------------------------------------------------------------
qwen3.5-4b                     GPU        vision-language-chat, tools 5.36 GB      apache-2.0   qwen3.5-4b-cuda-gpu:2
                               GPU        vision-language-chat, tools 5.36 GB      apache-2.0   qwen3.5-4b-generic-gpu:2
                               CPU        vision-language-chat, tools 4.28 GB      apache-2.0   qwen3.5-4b-generic-cpu:2
---------------------------------------------------------------------------------------------------------------
qwen3.5-9b                     GPU        vision-language-chat, tools 9.43 GB      apache-2.0   qwen3.5-9b-cuda-gpu:2
                               GPU        vision-language-chat, tools 9.43 GB      apache-2.0   qwen3.5-9b-generic-gpu:2
                               CPU        vision-language-chat, tools 7.89 GB      apache-2.0   qwen3.5-9b-generic-cpu:2
---------------------------------------------------------------------------------------------------------------
olmo-3-7b-instruct             GPU        chat, tools    5.07 GB      apache-2.0   olmo-3-7b-instruct-cuda-gpu:1
                               GPU        chat, tools    5.51 GB      apache-2.0   olmo-3-7b-instruct-generic-gpu:1
                               CPU        chat, tools    5.20 GB      apache-2.0   olmo-3-7b-instruct-generic-cpu:1
-----------------------------------------------------------------------------------------------------------------------
smollm3-3b                     GPU        chat, tools    2.02 GB      apache-2.0   smollm3-3b-cuda-gpu:1
                               GPU        chat, tools    2.20 GB      apache-2.0   smollm3-3b-generic-gpu:1
                               CPU        chat, tools    2.08 GB      apache-2.0   smollm3-3b-generic-cpu:1
---------------------------------------------------------------------------------------------------------------
mistral-nemo-12b-instruct      GPU        chat, tools    6.61 GB      apache-2.0   mistral-nemo-12b-instruct-cuda-gpu:1
                               GPU        chat, tools    7.29 GB      apache-2.0   mistral-nemo-12b-instruct-generic-gpu:1
                               CPU        chat, tools    6.81 GB      apache-2.0   mistral-nemo-12b-instruct-generic-cpu:1
------------------------------------------------------------------------------------------------------------------------------
deepseek-r1-1.5b               GPU        chat           1.43 GB      MIT          DeepSeek-R1-Distill-Qwen-1.5B-trtrtx-gpu:2

PS C:\Users\david> foundry model download Phi-3.5-mini-instruct-cuda-gpu
[14:09:16 ERR] Failed to process model #0 on page 1.
[14:09:16 ERR] Failed to process model #0 on page 1.
[14:09:16 ERR] Failed to process model #0 on page 1.
[14:09:16 ERR] Failed to process model #0 on page 1.
[14:09:17 ERR] Failed to process model #0 on page 2.
[14:09:17 ERR] Failed to process model #0 on page 2.
[14:09:17 ERR] Failed to process model #0 on page 2.
[14:09:17 ERR] Failed to process model #0 on page 2.
Downloading Phi-3.5-mini-instruct-cuda-gpu:2...
[####################################] 100.00 % [Time remaining: about 0s]       116.0 MB/s
Tips:
- To find model cache location use: foundry cache location
- To find models already downloaded use: foundry cache ls

PS C:\Users\david> foundry service start
🟢 Service is already running on http://127.0.0.1:59058/.
PS C:\Users\david> foundry model load Phi-3.5-mini-instruct-cuda-gpu
[14:10:18 ERR] Failed to process model #0 on page 1.
[14:10:18 ERR] Failed to process model #0 on page 1.
[14:10:18 ERR] Failed to process model #0 on page 1.
[14:10:18 ERR] Failed to process model #0 on page 1.
[14:10:19 ERR] Failed to process model #0 on page 2.
[14:10:19 ERR] Failed to process model #0 on page 2.
[14:10:19 ERR] Failed to process model #0 on page 2.
[14:10:19 ERR] Failed to process model #0 on page 2.
🕚 Loading model...
🟢 Model Phi-3.5-mini-instruct-cuda-gpu loaded successfully
PS C:\Users\david>`

[Panepo]

Hi @bmehta001,

Here are the all logs
aitik.zip
foundry.zip

[Panepo]

Hi @bmehta001,

The error still pops after re-installation

C:\>winget install Microsoft.FoundryLocal
Found Foundry Local [Microsoft.FoundryLocal] Version 0.8.119.102
This application is licensed to you by its owner.
Microsoft is not responsible for, nor does it grant any licenses to, third-party packages.
This package requires the following dependencies:
  - Packages
      Microsoft.VCLibs.Desktop.14 [>= 14.0.33728.0]
Successfully verified installer hash
Starting package install...
  ██████████████████████████████  100%
Successfully installed

C:\>foundry model download phi-4-mini-instruct-vitis-npu:2
🟢 Service is Started on http://127.0.0.1:65406/, PID 14816!
🕗 Downloading complete!...
Successfully downloaded and registered the following EPs: MIGraphXExecutionProvider, NvTensorRTRTXExecutionProvider, VitisAIExecutionProvider, CUDAExecutionProvider.
Valid EPs: CPUExecutionProvider, WebGpuExecutionProvider, NvTensorRTRTXExecutionProvider, VitisAIExecutionProvider, CUDAExecutionProvider
[20:56:16 WRN] Failed: Fetching model list from Foundry Catalog
Exception: No models were returned from the Azure Foundry catalog.

C:\>foundry model list
[20:56:30 ERR] Failed to process model #0 on page 1.
[20:56:30 ERR] Failed to process model #0 on page 1.
[20:56:30 ERR] Failed to process model #0 on page 1.
[20:56:30 ERR] Failed to process model #0 on page 1.
[20:56:31 ERR] Failed to process model #0 on page 2.
[20:56:31 ERR] Failed to process model #0 on page 2.
[20:56:31 ERR] Failed to process model #0 on page 2.
[20:56:31 ERR] Failed to process model #0 on page 2.
Alias                          Device     Task           File Size    License      Model ID
-----------------------------------------------------------------------------------------------
qwen2.5-coder-0.5b             NPU        chat, tools    0.52 GB      apache-2.0   qwen2.5-coder-0.5b-instruct-vitis-npu:2
                               GPU        chat           0.52 GB      MIT          qwen2.5-coder-0.5b-instruct-trtrtx-gpu:2
                               GPU        chat, tools    0.52 GB      apache-2.0   qwen2.5-coder-0.5b-instruct-cuda-gpu:4
                               GPU        chat, tools    0.52 GB      apache-2.0   qwen2.5-coder-0.5b-instruct-generic-gpu:4
                               CPU        chat, tools    0.80 GB      apache-2.0   qwen2.5-coder-0.5b-instruct-generic-cpu:4
--------------------------------------------------------------------------------------------------------------------------------
phi-4-mini-reasoning           NPU        chat           2.78 GB      MIT          Phi-4-mini-reasoning-vitis-npu:2
                               GPU        chat           3.15 GB      MIT          Phi-4-mini-reasoning-cuda-gpu:3
                               GPU        chat           3.15 GB      MIT          Phi-4-mini-reasoning-generic-gpu:3
                               CPU        chat           4.52 GB      MIT          Phi-4-mini-reasoning-generic-cpu:3
-------------------------------------------------------------------------------------------------------------------------
qwen2.5-0.5b                   NPU        chat, tools    0.52 GB      apache-2.0   qwen2.5-0.5b-instruct-vitis-npu:3
                               GPU        chat           0.52 GB      MIT          qwen2.5-0.5b-instruct-trtrtx-gpu:2
                               GPU        chat, tools    0.52 GB      apache-2.0   qwen2.5-0.5b-instruct-cuda-gpu:4
                               GPU        chat, tools    0.68 GB      apache-2.0   qwen2.5-0.5b-instruct-generic-gpu:4
                               CPU        chat, tools    0.80 GB      apache-2.0   qwen2.5-0.5b-instruct-generic-cpu:4
--------------------------------------------------------------------------------------------------------------------------
qwen2.5-1.5b                   GPU        chat           1.25 GB      MIT          qwen2.5-1.5b-instruct-trtrtx-gpu:2
                               GPU        chat, tools    1.25 GB      apache-2.0   qwen2.5-1.5b-instruct-cuda-gpu:4
                               GPU        chat, tools    1.51 GB      apache-2.0   qwen2.5-1.5b-instruct-generic-gpu:4
                               CPU        chat, tools    1.78 GB      apache-2.0   qwen2.5-1.5b-instruct-generic-cpu:4
--------------------------------------------------------------------------------------------------------------------------
qwen2.5-coder-1.5b             NPU        chat, tools    1.25 GB      apache-2.0   qwen2.5-coder-1.5b-instruct-vitis-npu:2
                               GPU        chat           1.25 GB      MIT          qwen2.5-coder-1.5b-instruct-trtrtx-gpu:2
                               GPU        chat, tools    1.25 GB      apache-2.0   qwen2.5-coder-1.5b-instruct-cuda-gpu:4
                               GPU        chat, tools    1.25 GB      apache-2.0   qwen2.5-coder-1.5b-instruct-generic-gpu:4
                               CPU        chat, tools    1.78 GB      apache-2.0   qwen2.5-coder-1.5b-instruct-generic-cpu:4
--------------------------------------------------------------------------------------------------------------------------------
phi-4-mini                     NPU        chat, tools    3.60 GB      MIT          phi-4-mini-instruct-vitis-npu:2
                               GPU        chat, tools    3.60 GB      MIT          Phi-4-mini-instruct-cuda-gpu:5
                               GPU        chat, tools    3.72 GB      MIT          Phi-4-mini-instruct-generic-gpu:5
                               CPU        chat, tools    4.80 GB      MIT          Phi-4-mini-instruct-generic-cpu:5
------------------------------------------------------------------------------------------------------------------------
qwen2.5-14b                    GPU        chat           8.79 GB      MIT          qwen2.5-14b-instruct-trtrtx-gpu:2
                               GPU        chat, tools    8.79 GB      apache-2.0   qwen2.5-14b-instruct-cuda-gpu:4
                               GPU        chat, tools    9.30 GB      apache-2.0   qwen2.5-14b-instruct-generic-gpu:4
                               CPU        chat, tools    11.06 GB     apache-2.0   qwen2.5-14b-instruct-generic-cpu:4
-------------------------------------------------------------------------------------------------------------------------
qwen2.5-coder-14b              GPU        chat           8.79 GB      MIT          qwen2.5-coder-14b-instruct-trtrtx-gpu:2
                               GPU        chat, tools    8.79 GB      apache-2.0   qwen2.5-coder-14b-instruct-cuda-gpu:4
                               GPU        chat, tools    8.79 GB      apache-2.0   qwen2.5-coder-14b-instruct-generic-gpu:4
                               CPU        chat, tools    11.06 GB     apache-2.0   qwen2.5-coder-14b-instruct-generic-cpu:4
-------------------------------------------------------------------------------------------------------------------------------
qwen2.5-coder-7b               NPU        chat, tools    4.73 GB      apache-2.0   qwen2.5-coder-7b-instruct-vitis-npu:2
                               GPU        chat           4.73 GB      MIT          qwen2.5-coder-7b-instruct-trtrtx-gpu:2
                               GPU        chat, tools    4.73 GB      apache-2.0   qwen2.5-coder-7b-instruct-cuda-gpu:4
                               GPU        chat, tools    4.73 GB      apache-2.0   qwen2.5-coder-7b-instruct-generic-gpu:4
                               CPU        chat, tools    6.16 GB      apache-2.0   qwen2.5-coder-7b-instruct-generic-cpu:4
------------------------------------------------------------------------------------------------------------------------------
qwen2.5-7b                     NPU        chat, tools    5.20 GB      apache-2.0   qwen2.5-7b-instruct-vitis-npu:2
                               GPU        chat           5.49 GB      MIT          qwen2.5-7b-instruct-trtrtx-gpu:2
                               GPU        chat, tools    4.73 GB      apache-2.0   qwen2.5-7b-instruct-cuda-gpu:4
                               GPU        chat, tools    5.20 GB      apache-2.0   qwen2.5-7b-instruct-generic-gpu:4
                               CPU        chat, tools    6.16 GB      apache-2.0   qwen2.5-7b-instruct-generic-cpu:4
------------------------------------------------------------------------------------------------------------------------
gpt-oss-20b                    CPU        chat           12.26 GB     MIT          gpt-oss-20b-generic-cpu:1
                               GPU        chat           9.65 GB      apache-2.0   gpt-oss-20b-cuda-gpu:1
                               GPU        chat           11.78 GB     MIT          gpt-oss-20b-generic-gpu:1
----------------------------------------------------------------------------------------------------------------
phi-3-mini-128k                NPU        chat           2.13 GB      MIT          phi-3-mini-128k-instruct-vitis-npu:2
                               GPU        chat           2.13 GB      MIT          phi-3-mini-128k-instruct-trtrtx-gpu:2
                               GPU        chat           2.13 GB      MIT          Phi-3-mini-128k-instruct-cuda-gpu:2
                               GPU        chat           2.13 GB      MIT          Phi-3-mini-128k-instruct-generic-gpu:2
                               CPU        chat           2.54 GB      MIT          Phi-3-mini-128k-instruct-generic-cpu:3
-----------------------------------------------------------------------------------------------------------------------------
phi-3.5-mini                   GPU        chat           2.13 GB      MIT          phi-3.5-mini-instruct-trtrtx-gpu:2
                               GPU        chat           2.13 GB      MIT          Phi-3.5-mini-instruct-cuda-gpu:2
                               GPU        chat           2.16 GB      MIT          Phi-3.5-mini-instruct-generic-gpu:2
                               CPU        chat           2.53 GB      MIT          Phi-3.5-mini-instruct-generic-cpu:2
--------------------------------------------------------------------------------------------------------------------------
phi-4                          GPU        chat           8.37 GB      MIT          Phi-4-trtrtx-gpu:2
                               GPU        chat           8.37 GB      MIT          Phi-4-cuda-gpu:2
                               GPU        chat           8.37 GB      MIT          Phi-4-generic-gpu:2
                               CPU        chat           10.16 GB     MIT          Phi-4-generic-cpu:2
----------------------------------------------------------------------------------------------------------
deepseek-r1-7b                 NPU        chat           5.58 GB      MIT          DeepSeek-R1-Distill-Qwen-7B-vitis-npu:2
                               GPU        chat           5.28 GB      MIT          deepseek-r1-distill-qwen-7b-cuda-gpu:4
                               GPU        chat           5.58 GB      MIT          deepseek-r1-distill-qwen-7b-generic-gpu:4
                               CPU        chat           6.43 GB      MIT          deepseek-r1-distill-qwen-7b-generic-cpu:4
                               GPU        chat           5.28 GB      MIT          DeepSeek-R1-Distill-Qwen-7B-trtrtx-gpu:2
-------------------------------------------------------------------------------------------------------------------------------
phi-3-mini-4k                  NPU        chat           2.13 GB      MIT          Phi-3-mini-4k-instruct-vitis-npu:2
                               GPU        chat           2.13 GB      MIT          phi-3-mini-4k-instruct-trtrtx-gpu:2
                               GPU        chat           2.13 GB      MIT          Phi-3-mini-4k-instruct-cuda-gpu:2
                               GPU        chat           2.13 GB      MIT          Phi-3-mini-4k-instruct-generic-gpu:2
                               CPU        chat           2.53 GB      MIT          Phi-3-mini-4k-instruct-generic-cpu:3
---------------------------------------------------------------------------------------------------------------------------
mistral-7b-v0.2                NPU        chat           4.07 GB      apache-2.0   Mistral-7B-Instruct-v0-2-vitis-npu:2
                               GPU        chat           3.98 GB      Apache-2.0   mistralai-Mistral-7B-Instruct-v0-2-trtrtx-gpu:2
                               GPU        chat           3.98 GB      apache-2.0   mistralai-Mistral-7B-Instruct-v0-2-cuda-gpu:2
                               GPU        chat           4.07 GB      apache-2.0   mistralai-Mistral-7B-Instruct-v0-2-generic-gpu:2
                               CPU        chat           4.07 GB      apache-2.0   mistralai-Mistral-7B-Instruct-v0-2-generic-cpu:3
---------------------------------------------------------------------------------------------------------------------------------------
deepseek-r1-14b                GPU        chat           9.83 GB      MIT          deepseek-r1-distill-qwen-14b-trtrtx-gpu:2
                               GPU        chat           9.83 GB      MIT          deepseek-r1-distill-qwen-14b-cuda-gpu:4
                               GPU        chat           10.27 GB     MIT          deepseek-r1-distill-qwen-14b-generic-gpu:4
                               CPU        chat           11.51 GB     MIT          deepseek-r1-distill-qwen-14b-generic-cpu:4
---------------------------------------------------------------------------------------------------------------------------------
qwen3-vl-4b-instruct           GPU        vision-language-chat, tools 3.48 GB      apache-2.0   qwen3-vl-4b-instruct-cuda-gpu:2
                               CPU        vision-language-chat, tools 2.73 GB      apache-2.0   qwen3-vl-4b-instruct-generic-cpu:3
                               CPU        vision-language-chat, tools 2.73 GB      apache-2.0   QWEN3-VL-4B-INSTRUCT-GENERIC-CPU:2
-------------------------------------------------------------------------------------------------------------------------
qwen3-14b                      GPU        chat, tools    9.08 GB      apache-2.0   qwen3-14b-cuda-gpu:2
                               GPU        chat, tools    9.93 GB      apache-2.0   qwen3-14b-generic-gpu:2
                               CPU        chat, tools    9.31 GB      apache-2.0   qwen3-14b-generic-cpu:2
--------------------------------------------------------------------------------------------------------------
qwen3-1.7b                     GPU        chat, tools    1.29 GB      apache-2.0   qwen3-1.7b-cuda-gpu:2
                               GPU        chat, tools    1.39 GB      apache-2.0   qwen3-1.7b-generic-gpu:2
                               CPU        chat, tools    1.32 GB      apache-2.0   qwen3-1.7b-generic-cpu:2
---------------------------------------------------------------------------------------------------------------
qwen3-vl-2b-instruct           GPU        vision-language-chat, tools 2.11 GB      apache-2.0   qwen3-vl-2b-instruct-cuda-gpu:2
                               CPU        vision-language-chat, tools 1.34 GB      apache-2.0   qwen3-vl-2b-instruct-generic-cpu:2
-------------------------------------------------------------------------------------------------------------------------
qwen3-4b                       GPU        chat, tools    2.63 GB      apache-2.0   qwen3-4b-cuda-gpu:2
                               GPU        chat, tools    2.87 GB      apache-2.0   qwen3-4b-generic-gpu:2
                               CPU        chat, tools    2.70 GB      apache-2.0   qwen3-4b-generic-cpu:3
-------------------------------------------------------------------------------------------------------------
qwen3-0.6b                     GPU        chat, tools    0.48 GB      apache-2.0   qwen3-0.6b-cuda-gpu:2
                               GPU        chat, tools    0.52 GB      apache-2.0   qwen3-0.6b-generic-gpu:2
                               CPU        chat, tools    0.58 GB      apache-2.0   qwen3-0.6b-generic-cpu:4
---------------------------------------------------------------------------------------------------------------
qwen3-8b                       GPU        chat, tools    5.54 GB      apache-2.0   qwen3-8b-cuda-gpu:2
                               GPU        chat, tools    6.00 GB      apache-2.0   qwen3-8b-generic-gpu:2
                               CPU        chat, tools    5.67 GB      apache-2.0   qwen3-8b-generic-cpu:2
-------------------------------------------------------------------------------------------------------------
qwen3-vl-8b-instruct           GPU        vision-language-chat, tools 5.99 GB      apache-2.0   qwen3-vl-8b-instruct-cuda-gpu:2
                               CPU        vision-language-chat, tools 4.96 GB      apache-2.0   qwen3-vl-8b-instruct-generic-cpu:2
-------------------------------------------------------------------------------------------------------------------------
qwen3.5-0.8b                   GPU        vision-language-chat, tools 1.32 GB      apache-2.0   qwen3.5-0.8b-cuda-gpu:2
                               GPU        vision-language-chat, tools 1.31 GB      apache-2.0   qwen3.5-0.8b-generic-gpu:2
                               CPU        vision-language-chat, tools 0.88 GB      apache-2.0   qwen3.5-0.8b-generic-cpu:2
-----------------------------------------------------------------------------------------------------------------
qwen3.5-2b                     GPU        vision-language-chat, tools 3.13 GB      apache-2.0   qwen3.5-2b-cuda-gpu:2
                               GPU        vision-language-chat, tools 3.13 GB      apache-2.0   qwen3.5-2b-generic-gpu:2
                               CPU        vision-language-chat, tools 2.10 GB      apache-2.0   qwen3.5-2b-generic-cpu:2
---------------------------------------------------------------------------------------------------------------
qwen3.5-4b                     GPU        vision-language-chat, tools 5.36 GB      apache-2.0   qwen3.5-4b-cuda-gpu:2
                               GPU        vision-language-chat, tools 5.36 GB      apache-2.0   qwen3.5-4b-generic-gpu:2
                               CPU        vision-language-chat, tools 4.28 GB      apache-2.0   qwen3.5-4b-generic-cpu:2
---------------------------------------------------------------------------------------------------------------
qwen3.5-9b                     GPU        vision-language-chat, tools 9.43 GB      apache-2.0   qwen3.5-9b-cuda-gpu:2
                               GPU        vision-language-chat, tools 9.43 GB      apache-2.0   qwen3.5-9b-generic-gpu:2
                               CPU        vision-language-chat, tools 7.89 GB      apache-2.0   qwen3.5-9b-generic-cpu:2
---------------------------------------------------------------------------------------------------------------
olmo-3-7b-instruct             GPU        chat, tools    5.07 GB      apache-2.0   olmo-3-7b-instruct-cuda-gpu:1
                               GPU        chat, tools    5.51 GB      apache-2.0   olmo-3-7b-instruct-generic-gpu:1
                               CPU        chat, tools    5.20 GB      apache-2.0   olmo-3-7b-instruct-generic-cpu:1
-----------------------------------------------------------------------------------------------------------------------
smollm3-3b                     GPU        chat, tools    2.02 GB      apache-2.0   smollm3-3b-cuda-gpu:1
                               GPU        chat, tools    2.20 GB      apache-2.0   smollm3-3b-generic-gpu:1
                               CPU        chat, tools    2.08 GB      apache-2.0   smollm3-3b-generic-cpu:1
---------------------------------------------------------------------------------------------------------------
mistral-nemo-12b-instruct      GPU        chat, tools    6.61 GB      apache-2.0   mistral-nemo-12b-instruct-cuda-gpu:1
                               GPU        chat, tools    7.29 GB      apache-2.0   mistral-nemo-12b-instruct-generic-gpu:1
                               CPU        chat, tools    6.81 GB      apache-2.0   mistral-nemo-12b-instruct-generic-cpu:1
------------------------------------------------------------------------------------------------------------------------------
deepseek-r1-1.5b               GPU        chat           1.43 GB      MIT          DeepSeek-R1-Distill-Qwen-1.5B-trtrtx-gpu:2


C:\>foundry model download phi-4-mini-instruct-vitis-npu:2
Downloading phi-4-mini-instruct-vitis-npu:2...
[####################################] 100.00 % [Time remaining: about 0s]         2.8 MB/s/s
Tips:
- To find model cache location use: foundry cache location
- To find models already downloaded use: foundry cache ls

C:\>foundry model load phi-4-mini-instruct-vitis-npu:2
[22:25:32 ERR] Failed to process model #0 on page 1.
[22:25:32 ERR] Failed to process model #0 on page 1.
[22:25:32 ERR] Failed to process model #0 on page 1.
[22:25:32 ERR] Failed to process model #0 on page 1.
🕐 Loading model... Exception: Request to local service failed. Uri:http://127.0.0.1:65406/openai/load/phi-4-mini-instruct-vitis-npu:2?ttl=600
An error occurred while sending the request.
Please check service status with 'foundry service status'.

C:\>foundry service status
🔴 Model management service is not running!
To start the service, run the following command: foundry service start