-
Notifications
You must be signed in to change notification settings - Fork 0
Python Bridge Syntax
Mike edited this page May 28, 2026
·
1 revision
llm = xlocllm.unit("LLM", "Qwen-3.5-0.8b")
rt = xlocllm.runtime([llm], mode="native", port=1146)
rt.run()
bridge = rt.bridge
print(bridge.url)
print(bridge.health())
print(bridge.status())bridge = xlocllm.NativeBridge(port=1146)
bridge.activate(daemon=True)
bridge.wait_ready(timeout=30)
print(bridge.url)bridge = xlocllm.Bridge(port=1146)
bridge.activate(daemon=True)
bridge.wait_ready(timeout=30, require_browser=True)one = xlocllm.GetBridge(port=1146)
all_known = xlocllm.GetBridge()
for bridge in all_known:
print(bridge.port, bridge.health())result = rt.bridge.invoke(
"chat.completions",
{
"model": llm.model,
"messages": [{"role": "user", "content": "hello"}],
},
)
print(result)- xlocllm
- Quickstart
- About
- Functions Python
- Functions TypeScript
- Use cases
- Examples Python
- Examples TypeScript
- Shared GPU mode
-
Models catalog
- Models The best
- Models Full model list
- Models Use your model
- For native mode
- Models Native LLM tiny small
- Models Native LLM medium
- Models Native LLM large
- Models Native embedding
- Models Native reranker
- Models Native translator
- Models Native tts
- Models Native vlm
- Models Native asr
- Models Native ocr
- Models Native image-classification
- Models Native object-detection
- Models Native image-segmentation
- Models Native depth-estimation
- Models Native document-layout
- Models Native table-detection
- Models Native document-qa
- Models Native language-id
- Models Native audio-classification
- Models Native text-classification
- Models Native ner
- Models Native zero-shot-text
- Models Native summarization
- Models Native text2text
- Models Native code
- For webgpu mode
- For web mode
- Models Web LLM
- Models Web embedding
- Models Web reranker
- Models Web translator
- Models Web tts
- Models Web vlm
- Models Web asr
- Models Web ocr
- Models Web image-classification
- Models Web object-detection
- Models Web image-segmentation
- Models Web depth-estimation
- Models Web document-layout
- Models Web table-detection
- Models Web document-qa
- Models Web zero-shot-image
- Models Web language-id
- Models Web audio-classification
- Models Web text-classification
- Models Web ner
- Models Web zero-shot-text
- Models Web summarization
- Models Web text2text
- Models Web code
- Dev