ERR_SSL_WRONG_VERSION_NUMBER

[adarshxs]

Model variable:

MODELS=`[
  {
    "name": "llama-2-7b-hf",
    "endpoints": [{"url": https://127.0.0.1:8080/generate_stream}],
    "description": "A good alternative to ChatGPT",
    "userMessageToken": "<|prompter|>",
    "assistantMessageToken": "<|assistant|>",
    "messageEndToken": "</s>",
    "preprompt": "A conversation between a user and an LLM-based AI assistant.",
    "parameters": {
      "temperature": 0.2,
      "top_p": 0.9,
      "repetition_penalty": 1.2,
      "top_k": 10,
      "truncate": 1000,
      "max_new_tokens": 500
    }
  }
]`

Error 500:
root@vitarcdl:/workspace/chat-ui# root@vitarcdl:/workspace/chat-ui# npm run dev --host > chat-ui@0.4.0 dev > vite dev VITE v4.3.5 ready in 1119 ms ➜ Local: http://localhost:5173/ ➜ Network: use --host to expose ➜ press h to show help Error: aborted at connResetException (node:internal/errors:720:14) at abortIncoming (node:_http_server:782:17) at socketOnClose (node:_http_server:776:3) at Socket.emit (node:events:526:35) at TCP. (node:net:337:12) { code: 'ECONNRESET' } TypeError: fetch failed at fetch (/workspace/chat-ui/node_modules/undici/index.js:109:13) at process.processTicksAndRejections (node:internal/process/task_queues:95:5) at async eval (/node_modules/@sveltejs/kit/src/runtime/server/fetch.js:32:10) at async POST (/src/routes/conversation/[id]/+server.ts:99:16) at async Module.render_endpoint (/node_modules/@sveltejs/kit/src/runtime/server/endpoint.js:47:20) at async resolve (/node_modules/@sveltejs/kit/src/runtime/server/respond.js:388:17) at async Object.handle (/src/hooks.server.ts:66:20) at async Module.respond (/node_modules/@sveltejs/kit/src/runtime/server/respond.js:259:20) at async file:///workspace/chat-ui/node_modules/@sveltejs/kit/src/exports/vite/dev/index.js:506:22 { cause: [Error: 00187E2BC17F0000:error:0A00010B:SSL routines:ssl3_get_record:wrong version number:../deps/openssl/openssl/ssl/record/ssl3_record.c:354: ] { library: 'SSL routines', reason: 'wrong version number', code: 'ERR_SSL_WRONG_VERSION_NUMBER' } }

[adarshxs]

Works if I change the endpoint from https -> http

"endpoints": [{"url": https://127.0.0.1:8080/generate_stream}], ---> "endpoints": [{"url": http://127.0.0.1:8080/generate_stream}],

[gary149]

Any reason for reopening? is this still broken?

[adarshxs]

Any reason for reopening? is this still broken?
No sorry I reopened it by mistake. Thanks