Dev About

Dev About

Техническая спецификация текущего состояния:

• package: xlocllm, Python >=3.10;
• default mode: native;
• native LLM backend: GGUF / llama.cpp-compatible;
• native non-LLM backend: ONNX Runtime;
• browser backend: MLC WebLLM и Transformers.js;
• bridge bind: 127.0.0.1;
• OpenAI-compatible base URL: http://127.0.0.1:<port>/v1;
• default port: 1146;
• catalog source: packages/catalog/native-models.json, packages/catalog/models.json.