This is my first post, sorry if it's not the right place. Non AVX version of KoboldCpp? #2256
-
|
Howdy everyone, I do hope this finds you well. I am sorry if this is not the right place but this is where the button mashing led me :) So onto my issue. I have an awesome legacy build that I've been rebuilding with "some" newer parts, like cooling fans and a couple of SSD. Other than that we are talking a D975XBX2 with a push/pull Scythe heatsink, a QX6700 CPU and a couple YES! 2 x Nvidia 1080ti GPUs all packed in a lovely silver Soprano DX case. NOW the CPU is where the system apparently falls over... something I had NO IDEA was even a thing... apparently it's doesn't have AVX (which I had to look up) and that means something to everyone here I'm guessing but sadly it didn't to me. I've been told that KoboldCpp is about the only inference engine that offers a working NON avx version.. I tried looking it up but alas I read that even their oldpc version requires AVX1 which my CPU sadly does not. Is there a version of SOMETHING I could use. I had to put Windows 10 Pro on the box as the Linux distro I used just didn't want to load either. So actually having a legit key for some reason I put W10P on (sorry if that a swear here) :) It's running sooooo smooth and I'd love dearly NOT to have to lose it to a newer box just to get an AI install happening. Help if possible?? Cheers |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 1 reply
-
|
Yes, non-avx is supported.
It should work Old PC = AVX1 required, no need AVX2 |
Beta Was this translation helpful? Give feedback.
-
|
Both Linux and Windows can do this. |
Beta Was this translation helpful? Give feedback.
Yes, non-avx is supported.
Please download the oldpc build:
https://github.com/LostRuins/koboldcpp/releases/download/v1.114.1/koboldcpp-oldpc.exe
Select "Use Vulkan (Older PC)"
It should work
Old PC = AVX1 required, no need AVX2
Older PC = No need both AVX1 or AVX2