Is there HTTPS Option?

[stardomains3]

llama.cpp allows to start server with self-signed certificate. --ssl-key-file and --ssl-cert-file . Can oMLX server be used in HTTPS mode?

[zviratko]

oMLX itself doesn't support that

a simple solution would be stunnel

echo "
[https]
accept = 8443
connect = 127.0.0.1:8000
cert = omlx.p12
" | sudo stunnel -fd 0

(not sure if there are any caveats with keepalives and stuff for different clients, this worked for me)

if you plan on exposing it to the internet then I'd recommend looking at Caddy