Bug: Server v2 doesn't load from .args #783
Description
Contact Details
No response
What happened?
This is my .args file:
--server
--v2
-m
myfile.gguf
-ngl
999
--prompt
"My prompt"
...
When I zipalign my llamafile and run it, the default CLI is loaded instead of server v2. This is because the .args are being read after determining which module to run (server, chat, cli). Instead, argv should be read from .args first and then determine which module to run.
Version
llamafile v0.9.3
What operating system are you seeing the problem on?
Windows