Support Windows Builds

[ravenscroftj]

Llama.cpp provides windows build support but currently turbopilot does not. A few people have been caught out by this (#17) - I would like to implement windows builds out of the box.

In order to make this work a new job needs to be added to the githhub action that builds codeserve which runs on windows and uploads the .exe artifact (the logic should be pretty much the same as the other builds). It may be necessary to copy workarounds for any windows specific quirks from llama.cpp

[JohnClaw]

I wait for Windows version. Will it run on 16gb ram?

[ravenscroftj]

Sure - yes the 2B and 6B models both seem to run in 16GB RAM when I've tested it on Linux - hopefully performance is similar on Windows. I'll be looking at Windows builds in the next couple of weeks!

[notBradPitt]

Looking forward to this 🙌

[ravenscroftj]

Windows builds are now supported in the CI - when I package up v0.0.5 (hopefully tomorrow) I will provide windows binaries.

[ravenscroftj]

Windows binaries now available in the v0.0.5 release