bug: Cant start models

[mike2003]

I downloaded the model from the hub (any model)
I run the model, the bar appears and then goes away.
Log:
2024-02-09T16:27:04.967Z [NITRO]::Debug: Nitro is ready
2024-02-09T16:27:04.968Z [NITRO]::Debug: Loading model with params {"ctx_len":4096,"prompt_template":"<|system|>\n{system_message}<|user|>\n{prompt}<|assistant|>","llama_model_path":"C:\Users\***\jan\models\tinyllama-1.1b\tinyllama-1.1b-chat-v1.0.Q4_K_M.gguf","system_prompt":"<|system|>\n","user_prompt":"<|user|>\n","ai_prompt":"<|assistant|>","cpu_threads":5,"ngl":100}
2024-02-09T16:27:04.982Z [NITRO]::Debug: 94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m\�[93m_�[94m_�[93m\�[94m/�[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m �[93m �[94m\�[93m_�[94m_�[93m\�[94m/�[93m �[94m �[93m �[94m �[0m
�[0m20240209 16:27:04.700000 UTC 9316 INFO Nitro version: - main.cc:50
20240209 16:27:04.701000 UTC 9316 INFO Server started, listening at: 127.0.0.1:3928 - main.cc:54
20240209 16:27:04.701000 UTC 9316 INFO Please load your model - main.cc:55
20240209 16:27:04.701000 UTC 9316 INFO Number of thread is:8 - main.cc:62
{"timestamp":1707496024,"level":"INFO","function":"loadModelImpl","line":561,"message":"system info","n_threads":5,"total_threads":8,"system_info":"AVX = 1 | AVX_VNNI = 0 | AVX2 = 1 | AVX512 = 0 | AVX512_VBMI = 0 | AVX512_VNNI = 0 | FMA = 1 | NEON = 0 | ARM_FMA = 0 | F16C = 1 | FP16_VA = 0 | WASM_SIMD = 0 | BLAS = 0 | SSE3 = 1 | SSSE3 = 0 | VSX = 0 | "}

2024-02-09T16:27:05.002Z [NITRO]::Debug: Nitro exited with code: 3221225501
2024-02-09T16:27:06.525Z [NITRO]::Error: TypeError: fetch failed
2024-02-09T16:27:06.524Z [NITRO]::Error: Load model failed with error TypeError: fetch failed

What's wrong?

Environment details
Win10x64

• Jan Version: 0.4.6

[louis-jan]

@mike2003 Oops, could you please help me find the app.log file and attach it here? You can navigate to the app data folder by going to Settings > Advanced > Jan Data Folder. There should be a folder named logs.

[mike2003]

After some research, here's what I thought - I have an old processor without avx2.
Is avx2 required to work?

[louis-jan]

After some research, here's what I thought - I have an old processor without avx2. Is avx2 required to work?

I think so, cc @tikikun

[chuckpen]

Hi, I was told by your Discord mod to post my log file here.
jan-nitro.txt

[mike2003]

Where is this file?

[louis-jan]

Hi, I was told by your Discord mod to post my log file here. jan-nitro.txt

It seems you are running with GPU enabled (win-cuda-12-0\nitro.exe), could you help us provide the Nvidia Cuda Driver & Toolkit version on your machine?

[louis-jan]

Where is this file?

You can find the logs under Jan Data Folder (Go to Settings > Advanced Settings > Jan Data Folder)

[mike2003]

You can find

No such file "jan-nitro.txt"

[chuckpen]

Hi, I have CUDA Toolkit 12.3 Update 2 and Nvidia Driver 551.52 installed.

…

On Sat, Feb 17, 2024 at 11:36 PM Louis ***@***.***> wrote: Hi, I was told by your Discord mod to post my log file here. jan-nitro.txt <https://github.com/janhq/jan/files/14303798/jan-nitro.txt> It seems you are running with GPU enabled (win-cuda-12-0\nitro.exe), could you help us provide the Nvidia Cuda Driver & Toolkit version on your machine? — Reply to this email directly, view it on GitHub <#1982 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/A4A62AAMNKGCOR67ZVRN76LYUGVQNAVCNFSM6AAAAABDBXU4RCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSNJQHE4TANRZGE> . You are receiving this because you commented.Message ID: ***@***.***>

[chuckpen]

See attached.

…

On Sun, Feb 18, 2024 at 2:03 AM Louis ***@***.***> wrote: You can find No such file "jan-nitro.txt" It's app.log — Reply to this email directly, view it on GitHub <#1982 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/A4A62AHEOGSF7YSZEP7LSBDYUHGVXAVCNFSM6AAAAABDBXU4RCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSNJRGA3DGNBTG4> . You are receiving this because you commented.Message ID: ***@***.***>

[mike2003]

where is jan-nitro.txt ?

[louis-jan]

where is jan-nitro.txt ?

It's actually app.log, @mike2003. You can find it in the app's logs folder under the Jan Data Folder (Settings > Advanced Settings > Jan Data Folder).

If you're on the latest Nightly Build, you can quickly copy it with this pop-up.

[louis-jan]

@mike2003. Please attach your computer specs and try the latest nightly build to see if this helps.

[Seedmanc]

The solution - #2111 (comment)

[louis-jan]

After some research, here's what I thought - I have an old processor without avx2. Is avx2 required to work?

That is confirmed. Please try the solution that @Seedmanc suggested.