Python Bridge Examples

Bridge Examples

Health and logs around a runtime

llm = xlocllm.unit("LLM", "Qwen-3.5-0.8b")
rt = xlocllm.runtime([llm], mode="native")
rt.run()

print(rt.bridge.health())
print(rt.bridge.logs(limit=50))

Delete one model cache entry

bridge = xlocllm.NativeBridge(port=1146).activate(daemon=True)
bridge.delete_model("LLM", "Qwen-3.5-0.8b")

OpenAI-compatible URL from bridge

rt = xlocllm.runtime([xlocllm.unit("LLM", "Qwen-3.5-0.8b")], mode="native")
rt.run()
print(rt.bridge.url)  # http://127.0.0.1:1146/v1

Existing bridge control

bridge = xlocllm.GetBridge(port=1146)
print(bridge.status())
bridge.reload(units=[xlocllm.unit("LLM", "Qwen-3.5-0.8b").to_payload()])