Docker Compose

[nsprawling]

Hi,

I'm trying to run llama-swap via docker compose. It starts, but on attempting to load models, I get the following:

llama-swap | 2026/08/07 13:25:48 http: proxy error: dial tcp [::1]:5801: connect: connection refused

This error repeats for two minutes until timeout.

I initially thought this was an ipv6 issue failing to connect to huggingface to download the model, there's an issue noted elsewhere with failing to fallback to ipv4 where ipv6 is unavailable but an AAAA record is received. However after getting the error to appear with an ipv4 address i don't think this is it. Is the model just still downloading?
I've searched for proxy error or connection refused under discussions but couldn't see similar.

[mostlygeek]

I'm guessing that "proxy" is not defined on the model and is defaulting to http://localhost:${PORT} and localhost is resolving to the ipv6 ip.

Try setting model.proxy to http://127.0.0.1:${PORT}.