Kilo Code. Wireguard and local llm (Llama.cpp/LM Studio)

[kaotika]

Hi, since this gave me quite a bit of trouble, I wanted to share my experience. Hopefully, it saves someone else some time and headaches! :D

I connected several machines via a Wireguard VPN. On one node, I set up llama.cpp (as well as other local LLM servers like LM Studio). Initially, I had trouble getting Kilo to work properly with these servers. While LLM detection worked fine, using the chat or agents resulted in a connection reset by host error.

The simple solution is to adjust the MTU setting for the Wireguard interfaces. I use an MTU of 1360. Below is the interface configuration snippet. You need to apply this setting on every host connected! Just update the config and restart the interface.

[Interface]
PrivateKey = ...
MTU = 1360