Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bug: 3221225501 processor does not support AVX instructions #2111

Closed
gf0067 opened this issue Feb 21, 2024 · 6 comments
Closed

bug: 3221225501 processor does not support AVX instructions #2111

gf0067 opened this issue Feb 21, 2024 · 6 comments
Assignees
Labels
status: wontfix This will not be worked on type: discussion Opening up a discussion

Comments

@gf0067
Copy link

gf0067 commented Feb 21, 2024

Any model downloaded cannot be run. The error is as follows:
2024-02-21T03:03:30.377Z [NITRO]::Debug: Nitro is ready,
2024-02-21T03:03:30.378Z [NITRO]::Debug: Loading model with params {"ctx_len":4096,"prompt_template":"[INST] <>\n{system_message}<>\n{prompt}[/INST]","llama_model_path":"C:\Users\Administrator\jan\models\llama2-chat-7b-q4\llama-2-7b-chat.Q4_K_M.gguf","system_prompt":"[INST] <>\n","user_prompt":"<>\n","ai_prompt":"[/INST]","cpu_threads":5,"ngl":100},
2024-02-21T03:03:30.386Z [NITRO]::Debug: Nitro exited with code: 3221225501,
2024-02-21T03:03:31.909Z [NITRO]::Error: TypeError: fetch failed,
2024-02-21T03:03:31.908Z [NITRO]::Error: Load model failed with error TypeError: fetch failed,
2024-02-21T03:04:28.941Z [NITRO]::CPU informations - 5,
2024-02-21T03:04:28.943Z [NITRO]::Debug: Request to kill Nitro,
2024-02-21T03:04:28.946Z [NITRO]::Debug: Nitro process is terminated,
2024-02-21T03:04:29.461Z [NITRO]::Debug: Spawn nitro at path: C:\Users\Administrator\jan\extensions@janhq\inference-nitro-extension\dist\bin\win-cuda-12-0\nitro.exe, and args: 1,127.0.0.1,3928,
2024-02-21T03:04:29.460Z [NITRO]::Debug: Spawning Nitro subprocess...,
2024-02-21T03:04:29.753Z [NITRO]::Debug: �[93m �[94m �[93m �[94m �[93m �[94m �[93m_�[94m_�[93m_�[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m_�[94m_�[93m_�[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m_�[94m_�[93m_�[94m �[93m �[94m �[93m �[94m �[0m,�[93m �[94m �[93m �[94m �[93m �[94m/�[93m_�[94m_�[93m/�[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m_�[93m_�[94m_�[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m_�[93m_�[94m_�[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m/�[94m �[93m �[94m/�[93m\�[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m/�[94m �[93m �[94m/�[93m\�[94m �[93m �[94m �[93m �[0m,�[93m �[94m �[93m �[94m �[93m �[94m\�[93m �[94m �[93m\�[94m:�[93m\�[94m �[93m �[94m �[93m �[94m �[93m �[94m/�[93m �[94m �[93m/�[94m\�[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m/�[93m �[94m �[93m/�[94m\�[93m �[94m �[93m �[94m �[93m �[94m �[93m/�[94m �[93m �[94m/�[93m:�[94m:�[93m\�[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m/�[94m �[93m �[94m/�[93m:�[94m:�[93m\�[94m �[93m �[94m �[0m,�[93m �[94m �[93m �[94m �[93m �[94m �[93m\�[94m �[93m �[94m\�[93m:�[94m\�[93m �[94m �[93m �[94m �[93m/�[94m �[93m �[94m/�[93m:�[94m/�[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m/�[94m �[93m �[94m/�[93m:�[94m/�[93m �[94m �[93m �[94m �[93m �[94m/�[93m �[94m �[93m/�[94m:�[93m/�[94m\�[93m:�[94m\�[93m �[94m �[93m �[94m �[93m �[94m/�[93m �[94m �[93m/�[94m:�[93m/�[94m\�[93m:�[94m\�[93m �[94m �[0m,�[93m �[94m �[93m_�[94m_�[93m_�[94m_�[93m_�[94m\�[93m_�[94m_�[93m\�[94m:�[93m\�[94m �[93m �[94m/�[93m_�[94m_�[93m/�[94m:�[93m:�[94m\�[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m/�[93m �[94m �[93m/�[94m:�[93m/�[94m �[93m �[94m �[93m �[94m �[93m/�[94m �[93m �[94m/�[93m:�[94m/�[93m �[94m �[93m\�[94m:�[93m\�[94m �[93m �[94m �[93m/�[94m �[93m �[94m/�[93m:�[94m/�[93m �[94m �[93m\�[94m:�[93m\�[94m �[0m,�[93m �[94m/�[93m_�[94m_�[93m/�[94m:�[93m:�[94m:�[93m:�[94m:�[93m:�[94m:�[93m:�[94m\�[93m �[94m\�[93m_�[94m_�[93m\�[94m/�[93m\�[94m:�[93m\�[94m_�[93m_�[94m �[93m �[94m �[93m/�[94m �[93m �[94m/�[93m:�[94m:�[93m\�[94m �[93m �[94m �[93m �[94m/�[93m_�[94m_�[93m/�[94m:�[93m/�[94m �[93m/�[94m:�[93m/�[94m_�[93m_�[94m_�[93m �[94m/�[93m_�[94m_�[93m/�[94m:�[93m/�[94m �[93m\�[94m_�[93m_�[94m\�[93m:�[94m\�[0m,�[93m �[94m\�[93m �[94m �[93m\�[94m:�[93m\�[94m�[93m�[94m\�[93m�[94m�[93m\�[94m/�[93m �[94m �[93m �[94m �[93m\�[94m �[93m �[94m\�[93m:�[94m\�[93m/�[94m\�[93m �[94m/�[93m_�[94m_�[93m/�[94m:�[93m/�[94m\�[93m:�[94m\�[93m �[94m �[93m �[94m\�[93m �[94m �[93m\�[94m:�[93m\�[94m/�[93m:�[94m:�[93m:�[94m:�[93m:�[94m/�[93m �[94m\�[93m �[94m �[93m\�[94m:�[93m\�[94m �[93m/�[94m �[93m �[94m/�[93m:�[94m/�[0m,�[93m �[94m �[93m\�[94m �[93m �[94m\�[93m:�[94m\�[93m �[94m �[93m�[94m�[93m�[94m �[93m �[94m �[93m �[94m �[93m �[94m\�[93m_�[94m_�[93m\�[94m:�[93m:�[94m/�[93m �[94m\�[93m_�[94m_�[93m\�[94m/�[93m �[94m �[93m\�[94m:�[93m\�[94m �[93m �[94m �[93m\�[94m �[93m �[94m\�[93m:�[94m:�[93m/�[94m�[93m�[94m�[93m�[94m �[93m �[94m �[93m\�[94m �[93m �[94m\�[93m:�[94m\�[93m �[94m �[93m/�[94m:�[93m/�[94m �[0m,�[93m �[94m �[93m �[94m\�[93m �[94m �[93m\�[94m:�[93m\�[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m/�[93m_�[94m_�[93m/�[94m:�[93m/�[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m\�[94m �[93m �[94m\�[93m:�[94m\�[93m �[94m �[93m �[94m\�[93m �[94m �[93m\�[94m:�[93m\�[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m\�[93m �[94m �[93m\�[94m:�[93m\�[94m/�[93m:�[94m/�[93m �[94m �[0m,�[93m �[94m �[93m �[94m �[93m\�[94m �[93m �[94m\�[93m:�[94m\�[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m\�[93m_�[94m_�[93m\�[94m/�[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m\�[93m_�[94m_�[93m\�[94m/�[93m �[94m �[93m �[94m �[93m\�[94m �[93m �[94m\�[93m:�[94m\�[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m\�[94m �[93m �[94m\�[93m:�[94m:�[93m/�[94m �[93m �[94m �[0m,�[93m �[94m �[93m �[94m �[93m �[94m\�[93m_�[94m_�[93m\�[94m/�[93m �[94m �[93m �[94m �[93m �[,
2024-02-21T03:04:30.092Z [NITRO]::Debug: Nitro is ready,
2024-02-21T03:04:30.092Z [NITRO]::Debug: Loading model with params {"ctx_len":4096,"prompt_template":"[INST] <>\n{system_message}<>\n{prompt}[/INST]","llama_model_path":"C:\Users\Administrator\jan\models\llama2-chat-7b-q4\llama-2-7b-chat.Q4_K_M.gguf","system_prompt":"[INST] <>\n","user_prompt":"<>\n","ai_prompt":"[/INST]","cpu_threads":5,"ngl":100},
2024-02-21T03:04:30.116Z [NITRO]::Debug: Nitro exited with code: 3221225501,
2024-02-21T03:04:31.641Z [NITRO]::Error: Load model failed with error TypeError: fetch failed,
2024-02-21T03:04:31.642Z [NITRO]::Error: TypeError: fetch failed,
2024-02-21T03:04:47.431Z [NITRO]::CPU informations - 5,
2024-02-21T03:04:47.432Z [NITRO]::Debug: Request to kill Nitro,
2024-02-21T03:04:47.436Z [NITRO]::Debug: Nitro process is terminated,
2024-02-21T03:04:47.942Z [NITRO]::Debug: Spawning Nitro subprocess...,
2024-02-21T03:04:47.943Z [NITRO]::Debug: Spawn nitro at path: C:\Users\Administrator\jan\extensions@janhq\inference-nitro-extension\dist\bin\win-cuda-12-0\nitro.exe, and args: 1,127.0.0.1,3928,
2024-02-21T03:04:48.069Z [NITRO]::Debug: �[93m �[94m �[93m �[94m �[93m �[94m �[93m_�[94m_�[93m_�[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m_�[94m_�[93m_�[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m_�[94m_�[93m_�[94m �[93m �[94m �[93m �[94m �[0m,�[93m �[94m �[93m �[94m �[93m �[94m/�[93m_�[94m_�[93m/�[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m_�[93m_�[94m_�[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m_�[93m_�[94m_�[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m/�[94m �[93m �[94m/�[93m\�[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m/�[94m �[93m �[94m/�[93m\�[94m �[93m �[94m �[93m �[0m,�[93m �[94m �[93m �[94m �[93m �[94m\�[93m �[94m �[93m\�[94m:�[93m\�[94m �[93m �[94m �[93m �[94m �[93m �[94m/�[93m �[94m �[93m/�[94m\�[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m/�[93m �[94m �[93m/�[94m\�[93m �[94m �[93m �[94m �[93m �[94m �[93m/�[94m �[93m �[94m/�[93m:�[94m:�[93m\�[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m/�[94m �[93m �[94m/�[93m:�[94m:�[93m\�[94m �[93m �[94m �[0m,�[93m �[94m �[93m �[94m �[93m �[94m �[93m\�[94m �[93m �[94m\�[93m:�[94m\�[93m �[94m �[93m �[94m �[93m/�[94m �[93m �[94m/�[93m:�[94m/�[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m/�[94m �[93m �[94m/�[93m:�[94m/�[93m �[94m �[93m �[94m �[93m �[94m/�[93m �[94m �[93m/�[94m:�[93m/�[94m\�[93m:�[94m\�[93m �[94m �[93m �[94m �[93m �[94m/�[93m �[94m �[93m/�[94m:�[93m/�[94m\�[93m:�[94m\�[93m �[94m �[0m,�[93m �[94m �[93m_�[94m_�[93m_�[94m_�[93m_�[94m\�[93m_�[94m_�[93m\�[94m:�[93m\�[94m �[93m �[94m/�[93m_�[94m_�[93m/�[94m:�[93m:�[94m\�[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m/�[93m �[94m �[93m/�[94m:�[93m/�[94m �[93m �[94m �[93m �[94m �[93m/�[94m �[93m �[94m/�[93m:�[94m/�[93m �[94m �[93m\�[94m:�[93m\�[94m �[93m �[94m �[93m/�[94m �[93m �[94m/�[93m:�[94m/�[93m �[94m �[93m\�[94m:�[93m\�[94m �[0m,�[93m �[94m/�[93m_�[94m_�[93m/�[94m:�[93m:�[94m:�[93m:�[94m:�[93m:�[94m:�[93m:�[94m\�[93m �[94m\�[93m_�[94m_�[93m\�[94m/�[93m\�[94m:�[93m\�[94m_�[93m_�[94m �[93m �[94m �[93m/�[94m �[93m �[94m/�[93m:�[94m:�[93m\�[94m �[93m �[94m �[93m �[94m/�[93m_�[94m_�[93m/�[94m:�[93m/�[94m �[93m/�[94m:�[93m/�[94m_�[93m_�[94m_�[93m �[94m/�[93m_�[94m_�[93m/�[94m:�[93m/�[94m �[93m\�[94m_�[93m_�[94m\�[93m:�[94m\�[0m,�[93m �[94m\�[93m �[94m �[93m\�[94m:�[93m\�[94m
�[93m�[94m\�[93m�[94m�[93m\�[94m/�[93m �[94m �[93m �[94m �[93m\�[94m �[93m �[94m\�[93m:�[94m\�[93m/�[94m\�[93m �[94m/�[93m_�[94m_�[93m/�[94m:�[93m/�[94m\�[93m:�[94m\�[93m �[94m �[93m �[94m\�[93m �[94m �[93m\�[94m:�[93m\�[94m/�[93m:�[94m:�[93m:�[94m:�[93m:�[94m/�[93m �[94m\�[93m �[94m �[93m\�[94m:�[93m\�[94m �[93m/�[94m �[93m �[94m/�[93m:�[94m/�[0m,�[93m �[94m �[93m\�[94m �[93m �[94m\�[93m:�[94m\�[93m �[94m �[93m�[94m�[93m�[94m �[93m �[94m �[93m �[94m �[93m �[94m\�[93m_�[94m_�[93m\�[94m:�[93m:�[94m/�[93m �[94m\�[93m_�[94m_�[93m\�[94m/�[93m �[94m �[93m\�[94m:�[93m\�[94m �[93m �[94m �[93m\�[94m �[93m �[94m\�[93m:�[94m:�[93m/�[94m�[93m�[94m�[93m�[94m �[93m �[94m �[93m\�[94m �[93m �[94m\�[93m:�[94m\�[93m �[94m �[93m/�[94m:�[93m/�[94m �[0m,�[93m �[94m �[93m �[94m\�[93m �[94m �[93m\�[94m:�[93m\�[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m/�[93m_�[94m_�[93m/�[94m:�[93m/�[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m\�[94m �[93m �[94m\�[93m:�[94m\�[93m �[94m �[93m �[94m\�[93m �[94m �[93m\�[94m:�[93m\�[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m\�[93m �[94m �[93m\�[94m:�[93m\�[94m/�[93m:�[94m/�[93m �[94m �[0m,�[93m �[94m �[93m �[94m �[93m\�[94m �[93m �[94m\�[93m:�[94m\�[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m\�[93m_�[94m_�[93m\�[94m/�[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m\�[93m_�[94m_�[93m\�[94m/�[93m �[94m �[93m �[94m �[93m\�[94m �[93m �[94m\�[93m:�[94m\�[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m\�[94m �[93m �[94m\�[93m:�[94m:�[93m/�[94m �[93m �[94m �[0m,�[93m �[94m �[93m �[94m �[93m �[94m\�[93m_�[94m_�[93m\�[94m/�[93m �[94m �[93m �[94m �[93m �[,
2024-02-21T03:04:48.573Z [NITRO]::Debug: Loading model with params {"ctx_len":4096,"prompt_template":"[INST] <>\n{system_message}<>\n{prompt}[/INST]","llama_model_path":"C:\Users\Administrator\jan\models\llama2-chat-7b-q4\llama-2-7b-chat.Q4_K_M.gguf","system_prompt":"[INST] <>\n","user_prompt":"<>\n","ai_prompt":"[/INST]","cpu_threads":5,"ngl":100},
2024-02-21T03:04:48.572Z [NITRO]::Debug: Nitro is ready,
2024-02-21T03:04:48.596Z [NITRO]::Debug: Nitro exited with code: 3221225501,
2024-02-21T03:04:50.111Z [NITRO]::Error: TypeError: fetch failed,
2024-02-21T03:04:50.110Z [NITRO]::Error: Load model failed with error TypeError: fetch failed,
2024-02-21T03:04:52.376Z [APP]::Error: Failed to fetch,
Device specs:
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Jan/0.4.6-279 Chrome/120.0.6099.56 Electron/28.0.0 Safari/537.36
Jan Version: 0.4.6.0
Looking forward to the reply, thank you!

@gf0067 gf0067 added the type: bug Something isn't working label Feb 21, 2024
@gf0067
Copy link
Author

gf0067 commented Feb 21, 2024

SYSTEM INFO:
Windows 10 professional 22H2
Windows Feature Experience Pack 1000.19053.1000.0
CPU Intel(R) Core(TM) i5-2320 CPU @ 3.00GHz 3.00 GHz
RAM 32.0 GB
GPU 2060 12GB

@louis-jan
Copy link
Contributor

SYSTEM INFO: Windows 10 professional 22H2 Windows Feature Experience Pack 1000.19053.1000.0 CPU Intel(R) Core(TM) i5-2320 CPU @ 3.00GHz 3.00 GHz RAM 32.0 GB GPU 2060 12GB

It appears that your specifications currently do not include AVX Instruction support, which may cause issues at the moment. We are working on addressing this issue and will provide updates in the future. Please stay tuned for further information.

@Van-QA Van-QA changed the title bug:Cant start models bug: 3221225501 processor does not support AVX instructions Feb 21, 2024
@Seedmanc
Copy link

I got it running using this emulator https://www.nexusmods.com/granbluefantasyrelink/mods/16 just replace the granblue exe to jan.exe in the 2 cmd files.

the startup can be slow though but then it works fast on GPU

@louis-jan
Copy link
Contributor

Thank you, @Seedmanc. I think support for old CPU architectures will not be planned anytime soon. Please try the suggestion above. We will close this as "not planned"

@louis-jan louis-jan closed this as not planned Won't fix, can't repro, duplicate, stale Mar 7, 2024
@0xSage 0xSage added status: wontfix This will not be worked on type: discussion Opening up a discussion and removed type: bug Something isn't working labels Mar 12, 2024
@Van-QA
Copy link
Contributor

Van-QA commented Mar 14, 2024

Linking to the follow up ticket: janhq/cortex#463

@Seedmanc
Copy link

You could at least integrate the existing solution or link to it in the readmes. To have a GPU-based AI app be limited by CPU is ridiculous when there are solutions.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
status: wontfix This will not be worked on type: discussion Opening up a discussion
Projects
Archived in project
Development

No branches or pull requests

7 participants