It Just kind of does nothing.

[Baggette]

After running the command it loads the model and then does nothing and exits. Not sure what the issue is

[Baggette]

even if I build from source the same thing happens

[envyvan]

Me too, seems like same as you are.
I'm using win10

[simple6502]

Same issue here, I am also using Windows 10

[envyvan]

Hmm.
Seems like I get some compile error with Cmake.
I can run the chat on linux with no error with my laptop.

PS C:\llama\alpaca.cpp> cmake .
-- Building for: Visual Studio 16 2019
-- Selecting Windows SDK version 10.0.19041.0 to target Windows 10.0.19045.
-- The C compiler identification is MSVC 19.29.30146.0
-- The CXX compiler identification is MSVC 19.29.30146.0
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working C compiler: C:/Program Files (x86)/Microsoft Visual Studio/2019/BuildTools/VC/Tools/MSVC/14.29.30133/bin/Hostx64/x64/cl.exe - skipped
-- Detecting C compile features
-- Detecting C compile features - done
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Check for working CXX compiler: C:/Program Files (x86)/Microsoft Visual Studio/2019/BuildTools/VC/Tools/MSVC/14.29.30133/bin/Hostx64/x64/cl.exe - skipped
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- CMAKE_SYSTEM_PROCESSOR: AMD64
-- x86 detected
-- Configuring done (6.0s)
-- Generating done (0.1s)
-- Build files have been written to: C:/llama/alpaca.cpp
PS C:\llama\alpaca.cpp> cmake --build . --config Release
用于 .NET Framework 的 Microsoft (R) 生成引擎版本 16.11.2+f32259642
版权所有(C) Microsoft Corporation。保留所有权利。

Checking Build System
Building Custom Rule C:/llama/alpaca.cpp/CMakeLists.txt
ggml.c
C:\Program Files (x86)\Windows Kits\10\Include\10.0.19041.0\um\winbase.h(9531,5): warning C5105: 生成“已定义”的宏扩展具有未定义的行为 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(413,13): warning C4101: “pp”: 未引用的局部变量 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(637,1): warning C4244: “初始化”: 从“double”转换到“const uint8_t”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(638,1): warning C4244: “初始化”: 从“double”转换到“const uint8_t”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(1257,14): warning C4244: “=”: 从“ggml_float”转换到“float”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(1293,14): warning C4244: “=”: 从“ggml_float”转换到“float”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(1679,23): warning C4244: “=”: 从“ggml_float”转换到“float”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(1904,125): warning C4244: “=”: 从“double”转换到“float”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(1906,127): warning C4244: “=”: 从“double”转换到“float”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(1916,72): warning C4244: “return”: 从“double”转换到“float”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(1945,29): warning C4244: “return”: 从“double”转换到“float”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(1978,13): warning C4244: “=”: 从“ggml_float”转换到“float”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(1990,10): warning C4244: “=”: 从“ggml_float”转换到“float”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(1996,125): warning C4244: “=”: 从“double”转换到“float”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(2390,37): warning C4244: “函数”: 从“double”转换到“float”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(2750,71): warning C4244: “函数”: 从“int32_t”转换到“const float”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(2782,71): warning C4244: “函数”: 从“float”转换到“const int8_t”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(2789,73): warning C4244: “函数”: 从“float”转换到“const int16_t”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(2796,73): warning C4244: “函数”: 从“float”转换到“const int32_t”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(2803,77): warning C4244: “函数”: 从“float”转换到“const int32_t”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(2850,77): warning C4244: “return”: 从“float”转换到“int32_t”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(2855,52): warning C4244: “return”: 从“float”转换到“int32_t”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(2863,16): warning C4244: “return”: 从“float”转换到“int32_t”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(2894,54): warning C4244: “函数”: 从“int32_t”转换到“float”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(2899,53): warning C4244: “=”: 从“int32_t”转换到“float”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(2931,54): warning C4244: “return”: 从“int32_t”转换到“float”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(2965,54): warning C4244: “=”: 从“float”转换到“int8_t”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(2970,55): warning C4244: “=”: 从“float”转换到“int16_t”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(2975,55): warning C4244: “=”: 从“float”转换到“int32_t”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(3933,25): warning C4267: “=”: 从“size_t”转换到“int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(3934,25): warning C4267: “=”: 从“size_t”转换到“int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(3935,25): warning C4267: “=”: 从“size_t”转换到“int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(3936,25): warning C4267: “=”: 从“size_t”转换到“int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(5410,31): warning C4244: “=”: 从“ggml_float”转换到“float”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(5414,1): warning C4244: “初始化”: 从“double”转换到“const float”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(5494,1): warning C4244: “初始化”: 从“double”转换到“const float”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(5576,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(5577,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(5578,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(5579,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(5581,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(5582,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(5583,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(5584,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(5586,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(5587,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(5588,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(5589,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(5751,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(5821,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(5822,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(5823,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(5824,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(5826,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(5827,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(5828,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(5829,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(5831,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(5832,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(5833,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(5834,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(6056,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(6127,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(6128,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(6129,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(6130,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(6132,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(6133,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(6134,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(6135,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(6137,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(6138,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(6139,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(6140,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(6356,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(6427,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(6428,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(6429,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(6430,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(6432,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(6433,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(6434,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(6435,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(6437,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(6438,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(6439,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(6440,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(6656,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7157,38): warning C4244: “函数”: 从“ggml_float”转换到“const float”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7241,62): warning C4244: “=”: 从“double”转换到“float”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7242,62): warning C4244: “=”: 从“double”转换到“float”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7214,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7215,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7216,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7217,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7297,80): warning C4244: “函数”: 从“double”转换到“float”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7298,80): warning C4244: “函数”: 从“double”转换到“float”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7271,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7272,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7273,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7274,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7361,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7362,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7363,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7366,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7367,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7372,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7481,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7482,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7483,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7486,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7487,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7492,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7629,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7630,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7631,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7634,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7635,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7640,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7749,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7750,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7751,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7754,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7755,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7760,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(8046,35): warning C4244: “+=”: 从“ggml_float”转换到“float”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(8053,26): warning C4244: “=”: 从“double”转换到“float”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7899,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7900,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7901,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7902,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7904,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7905,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7906,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7907,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7909,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7910,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7911,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7912,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7914,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7915,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7916,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7917,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(7971,1): warning C4244: “初始化”: 从“double”转换到“const float”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(8272,35): warning C4244: “+=”: 从“ggml_float”转换到“float”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(8279,26): warning C4244: “=”: 从“double”转换到“float”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(8108,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(8109,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(8110,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(8111,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(8113,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(8114,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(8115,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(8116,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(8118,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(8119,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(8120,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(8121,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(8123,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(8124,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(8125,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(8126,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(8180,1): warning C4244: “初始化”: 从“double”转换到“const float”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(8395,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(8396,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(8397,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(8398,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(8400,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(8401,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(8402,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(8403,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(8405,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(8410,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(8411,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(8412,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(8413,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(8415,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(8420,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(8421,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(8422,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(8423,1): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(9498,83): warning C4267: “函数”: 从“size_t”转换到“int”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(9763,17): warning C4996: 'fopen': This function or variable may be unsafe. Consider using fopen_s instead. To disable deprecation, us
e _CRT_SECURE_NO_WARNINGS. See online help for details. [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(10018,71): warning C4244: “函数”: 从“int”转换到“float”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
C:\llama\alpaca.cpp\ggml.c(10019,71): warning C4244: “函数”: 从“int”转换到“float”，可能丢失数据 [C:\llama\alpaca.cpp\ggml.vcxproj]
ggml.vcxproj -> C:\llama\alpaca.cpp\Release\ggml.lib
Building Custom Rule C:/llama/alpaca.cpp/CMakeLists.txt
chat.cpp
C:\llama\alpaca.cpp\chat.cpp(202,58): warning C4244: “+=”: 从“float”转换到“size_t”，可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj]
C:\llama\alpaca.cpp\chat.cpp(204,58): warning C4244: “+=”: 从“float”转换到“size_t”，可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj]
C:\llama\alpaca.cpp\chat.cpp(206,58): warning C4244: “+=”: 从“float”转换到“size_t”，可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj]
C:\llama\alpaca.cpp\chat.cpp(208,68): warning C4244: “+=”: 从“float”转换到“size_t”，可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj]
C:\llama\alpaca.cpp\chat.cpp(210,67): warning C4244: “+=”: 从“float”转换到“size_t”，可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj]
C:\llama\alpaca.cpp\chat.cpp(211,67): warning C4244: “+=”: 从“float”转换到“size_t”，可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj]
C:\llama\alpaca.cpp\chat.cpp(212,67): warning C4244: “+=”: 从“float”转换到“size_t”，可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj]
C:\llama\alpaca.cpp\chat.cpp(213,67): warning C4244: “+=”: 从“float”转换到“size_t”，可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj]
C:\llama\alpaca.cpp\chat.cpp(215,68): warning C4244: “+=”: 从“float”转换到“size_t”，可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj]
C:\llama\alpaca.cpp\chat.cpp(217,65): warning C4244: “+=”: 从“float”转换到“size_t”，可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj]
C:\llama\alpaca.cpp\chat.cpp(218,65): warning C4244: “+=”: 从“float”转换到“size_t”，可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj]
C:\llama\alpaca.cpp\chat.cpp(219,65): warning C4244: “+=”: 从“float”转换到“size_t”，可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj]
C:\llama\alpaca.cpp\chat.cpp(221,72): warning C4244: “+=”: 从“float”转换到“size_t”，可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj]
C:\llama\alpaca.cpp\chat.cpp(222,72): warning C4244: “+=”: 从“float”转换到“size_t”，可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj]
C:\llama\alpaca.cpp\chat.cpp(540,34): warning C4267: “初始化”: 从“size_t”转换到“int”，可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj]
C:\llama\alpaca.cpp\chat.cpp(540,34): warning C4267: “初始化”: 从“size_t”转换到“const int”，可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj]
C:\llama\alpaca.cpp\chat.cpp(559,40): warning C4244: “初始化”: 从“double”转换到“size_t”，可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj]
C:\llama\alpaca.cpp\chat.cpp(559,35): warning C4244: “初始化”: 从“double”转换到“const size_t”，可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj]
C:\llama\alpaca.cpp\chat.cpp(813,27): warning C4244: “=”: 从“time_t”转换到“int32_t”，可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj]
C:\llama\alpaca.cpp\chat.cpp(933,65): warning C4267: “初始化”: 从“size_t”转换到“int”，可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj]
C:\llama\alpaca.cpp\chat.cpp(962,30): warning C4267: “+=”: 从“size_t”转换到“int”，可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj]
C:\llama\alpaca.cpp\chat.cpp(967,39): warning C4244: “初始化”: 从“int32_t”转换到“float”，可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj]
C:\llama\alpaca.cpp\chat.cpp(967,31): warning C4244: “初始化”: 从“int32_t”转换到“const float”，可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj]
C:\llama\alpaca.cpp\chat.cpp(979,128): warning C4244: “参数”: 从“const float”转换到“int”，可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj]
C:\llama\alpaca.cpp\chat.cpp(1034,49): warning C4267: “=”: 从“size_t”转换到“int”，可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj]
C:\llama\alpaca.cpp\chat.cpp(1068,98): warning C4267: “-=”: 从“size_t”转换到“int”，可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj]
C:\llama\alpaca.cpp\chat.cpp(1047,25): warning C4996: 'scanf': This function or variable may be unsafe. Consider using scanf_s instead. To disable deprecation,
use _CRT_SECURE_NO_WARNINGS. See online help for details. [C:\llama\alpaca.cpp\chat.vcxproj]
C:\llama\alpaca.cpp\chat.cpp(1049,29): warning C4996: 'scanf': This function or variable may be unsafe. Consider using scanf_s instead. To disable deprecation,
use _CRT_SECURE_NO_WARNINGS. See online help for details. [C:\llama\alpaca.cpp\chat.vcxproj]
utils.cpp
C:\llama\alpaca.cpp\utils.cpp(160,28): warning C4267: “初始化”: 从“size_t”转换到“int”，可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj]
C:\llama\alpaca.cpp\utils.cpp(248,28): warning C4267: “初始化”: 从“size_t”转换到“int”，可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj]
C:\llama\alpaca.cpp\utils.cpp(285,28): warning C4267: “初始化”: 从“size_t”转换到“int”，可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj]
C:\llama\alpaca.cpp\utils.cpp(297,62): warning C4267: “初始化”: 从“size_t”转换到“int”，可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj]
C:\llama\alpaca.cpp\utils.cpp(319,28): warning C4267: “-=”: 从“size_t”转换到“int”，可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj]
C:\llama\alpaca.cpp\utils.cpp(373,44): warning C4267: “初始化”: 从“size_t”转换到“int”，可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj]
C:\llama\alpaca.cpp\utils.cpp(545,46): warning C4244: “初始化”: 从“float”转换到“uint8_t”，可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj]
C:\llama\alpaca.cpp\utils.cpp(545,39): warning C4244: “初始化”: 从“float”转换到“const uint8_t”，可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj]
C:\llama\alpaca.cpp\utils.cpp(546,46): warning C4244: “初始化”: 从“float”转换到“uint8_t”，可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj]
C:\llama\alpaca.cpp\utils.cpp(546,39): warning C4244: “初始化”: 从“float”转换到“const uint8_t”，可能丢失数据 [C:\llama\alpaca.cpp\chat.vcxproj]
正在生成代码...
chat.vcxproj -> C:\llama\alpaca.cpp\Release\chat.exe
Building Custom Rule C:/llama/alpaca.cpp/CMakeLists.txt
quantize.cpp
utils.cpp
C:\llama\alpaca.cpp\utils.cpp(160,28): warning C4267: “初始化”: 从“size_t”转换到“int”，可能丢失数据 [C:\llama\alpaca.cpp\quantize.vcxproj]
C:\llama\alpaca.cpp\utils.cpp(248,28): warning C4267: “初始化”: 从“size_t”转换到“int”，可能丢失数据 [C:\llama\alpaca.cpp\quantize.vcxproj]
C:\llama\alpaca.cpp\utils.cpp(285,28): warning C4267: “初始化”: 从“size_t”转换到“int”，可能丢失数据 [C:\llama\alpaca.cpp\quantize.vcxproj]
C:\llama\alpaca.cpp\utils.cpp(297,62): warning C4267: “初始化”: 从“size_t”转换到“int”，可能丢失数据 [C:\llama\alpaca.cpp\quantize.vcxproj]
C:\llama\alpaca.cpp\utils.cpp(319,28): warning C4267: “-=”: 从“size_t”转换到“int”，可能丢失数据 [C:\llama\alpaca.cpp\quantize.vcxproj]
C:\llama\alpaca.cpp\utils.cpp(373,44): warning C4267: “初始化”: 从“size_t”转换到“int”，可能丢失数据 [C:\llama\alpaca.cpp\quantize.vcxproj]
C:\llama\alpaca.cpp\utils.cpp(545,46): warning C4244: “初始化”: 从“float”转换到“uint8_t”，可能丢失数据 [C:\llama\alpaca.cpp\quantize.vcxproj]
C:\llama\alpaca.cpp\utils.cpp(545,39): warning C4244: “初始化”: 从“float”转换到“const uint8_t”，可能丢失数据 [C:\llama\alpaca.cpp\quantize.vcxproj]
C:\llama\alpaca.cpp\utils.cpp(546,46): warning C4244: “初始化”: 从“float”转换到“uint8_t”，可能丢失数据 [C:\llama\alpaca.cpp\quantize.vcxproj]
C:\llama\alpaca.cpp\utils.cpp(546,39): warning C4244: “初始化”: 从“float”转换到“const uint8_t”，可能丢失数据 [C:\llama\alpaca.cpp\quantize.vcxproj]
正在生成代码...
quantize.vcxproj -> C:\llama\alpaca.cpp\Release\quantize.exe
Building Custom Rule C:/llama/alpaca.cpp/CMakeLists.txt

[siavashtest1]

I have the same issue

[simple6502]

After some experimentation, on windows 11 it works out of the box, but not on windows 10, or at least the version that is running for me.

[simple6502]

After some experimentation, on windows 11 it works out of the box, but not on windows 10, or at least the version that is running for me.

After looking into it more, I was using Windows 10 IoT Enterprise LTSC so most likely there is something that the OS might not have compared to newer versions of Windows 10 & 11 because of it being in a long term support channel, not sure what it is exactly.

[liulirun]

same issue here, windows 10

[ZanziPanzi]

Had a same issue on Intel 2600k CPU.

Found reason in Win10 events: CPU doesn't support AVX2 instructions. Changed CMakeLists.txt to use AVX only instructions in section:

if (${CMAKE_SYSTEM_PROCESSOR} MATCHES "arm" OR ${CMAKE_SYSTEM_PROCESSOR} MATCHES "aarch64")
    message(STATUS "ARM detected")
else()
    message(STATUS "x86 detected")
    if (MSVC)
        set(CMAKE_CXX_FLAGS "${CMAKE_CXX_FLAGS} /arch:AVX") # Changed to AVX
        set(CMAKE_CXX_FLAGS_RELEASE "${CMAKE_CXX_FLAGS_RELEASE} /arch:AVX") # Changed to AVX
        set(CMAKE_C_FLAGS "${CMAKE_C_FLAGS} /arch:AVX") # Changed to AVX
    else()
        if(NOT LLAMA_NO_AVX)
            set(CMAKE_C_FLAGS "${CMAKE_C_FLAGS} -mavx")
        endif()
        if(NOT LLAMA_NO_AVX2)
            # set(CMAKE_C_FLAGS "${CMAKE_C_FLAGS} -mavx2") # Commented string
        endif()
        if(NOT LLAMA_NO_FMA)
            set(CMAKE_C_FLAGS "${CMAKE_C_FLAGS} -mfma")
        endif()
        set(CMAKE_C_FLAGS "${CMAKE_C_FLAGS} -mf16c")
    endif()
endif()

Recompiled project. Now all works.

[liulirun]

Had a same issue on Intel 2600k CPU.

Found reason in Win10 events: CPU doesn't support AVX2 instructions. Changed CMakeLists.txt to use AVX only instructions in section:

if (${CMAKE_SYSTEM_PROCESSOR} MATCHES "arm" OR ${CMAKE_SYSTEM_PROCESSOR} MATCHES "aarch64")
    message(STATUS "ARM detected")
else()
    message(STATUS "x86 detected")
    if (MSVC)
        set(CMAKE_CXX_FLAGS "${CMAKE_CXX_FLAGS} /arch:AVX") # Changed to AVX
        set(CMAKE_CXX_FLAGS_RELEASE "${CMAKE_CXX_FLAGS_RELEASE} /arch:AVX") # Changed to AVX
        set(CMAKE_C_FLAGS "${CMAKE_C_FLAGS} /arch:AVX") # Changed to AVX
    else()
        if(NOT LLAMA_NO_AVX)
            set(CMAKE_C_FLAGS "${CMAKE_C_FLAGS} -mavx")
        endif()
        if(NOT LLAMA_NO_AVX2)
            # set(CMAKE_C_FLAGS "${CMAKE_C_FLAGS} -mavx2") # Commented string
        endif()
        if(NOT LLAMA_NO_FMA)
            set(CMAKE_C_FLAGS "${CMAKE_C_FLAGS} -mfma")
        endif()
        set(CMAKE_C_FLAGS "${CMAKE_C_FLAGS} -mf16c")
    endif()
endif()

Recompiled project. Now all works.

This solution works for me. but interactive chat speed is really slow though..
type "give me python script example", takes more than 3 mins to responde

[ZanziPanzi]

This solution works for me. but interactive chat speed is really slow though..
type "give me python script example", takes more than 3 mins to responde

Yeah, same for me. I will try to use different compiler options, and reply if will find solution for speed. But it's seems like the code speed depends on AVX2 instructions, so maybe there is no solutions for old CPU's.

[liulirun]

Yeah, same for me. I will try to use different compiler options, and reply if will find solution for speed. But it's seems like the code speed depends on AVX2 instructions, so maybe there is no solutions for old CPU's.

thanks for the update, @ZanziPanzi

[GrahamboJangles]

This problem occurs for me sometimes if I overload the program with too high parameters. It may be your system isn't powerful enough. Try lowering the default launch options, like the --ctx_size, or the --batch_size. You can also try allocating more threads with --threads

[8bit-coder]

Weird thing is I have an i7-3770, and it supports AVX2. So why is mine having the same issue?

[ZanziPanzi]

Weird thing is I have an i7-3770, and it supports AVX2. So why is mine having the same issue?

Your CPU doesn't support AVX2 instructions (you have only AVX). AVX2 instructions in Intel CPUs started from Haswell microarchitecture (i7-4770 for example first series that supported AVX2).