Skip to content

Python Bridge Syntax

Mike edited this page May 28, 2026 · 1 revision

Bridge Syntax

Usually: access through Runtime

llm = xlocllm.unit("LLM", "Qwen-3.5-0.8b")
rt = xlocllm.runtime([llm], mode="native", port=1146)
rt.run()

bridge = rt.bridge
print(bridge.url)
print(bridge.health())
print(bridge.status())

Manual native bridge

bridge = xlocllm.NativeBridge(port=1146)
bridge.activate(daemon=True)
bridge.wait_ready(timeout=30)
print(bridge.url)

Manual web bridge

bridge = xlocllm.Bridge(port=1146)
bridge.activate(daemon=True)
bridge.wait_ready(timeout=30, require_browser=True)

Registry lookup

one = xlocllm.GetBridge(port=1146)
all_known = xlocllm.GetBridge()

for bridge in all_known:
    print(bridge.port, bridge.health())

Direct invoke through bridge

result = rt.bridge.invoke(
    "chat.completions",
    {
        "model": llm.model,
        "messages": [{"role": "user", "content": "hello"}],
    },
)
print(result)

Clone this wiki locally