-
Notifications
You must be signed in to change notification settings - Fork 0
Python Additional Invoke OpenAI
Mike edited this page May 28, 2026
·
1 revision
| Endpoint | Назначение |
|---|---|
GET /v1/models |
список моделей |
POST /v1/chat/completions |
chat completions |
POST /v1/chat/completions with stream=True
|
streaming chat completions |
POST /v1/responses |
Responses-like text output |
POST /v1/embeddings |
embeddings |
Используйте runtime.invoke(endpoint, payload) или bridge.invoke(endpoint, payload).
| Endpoint | Unit | Required input | Return shape |
|---|---|---|---|
chat.completions, chat
|
LLM |
messages or prompt
|
{content, raw?} |
responses |
LLM |
input |
response-like text content |
embeddings, embedding
|
embedding |
input |
{embeddings} |
rerank, reranker
|
reranker |
query, documents
|
{results} sorted by score |
translate, translator
|
translator |
text/input, optional languages |
translation output |
tts |
tts |
text/input
|
audio-like result |
image.classify, image-classification
|
image-classification |
image/input/url
|
{labels, raw} |
image.detect, object-detection
|
object-detection |
image/input/url
|
{boxes, raw} |
image.segment, image-segmentation
|
image-segmentation |
image/input/url
|
{segments, raw} |
depth, depth-estimation
|
depth-estimation |
image/input/url
|
{depth, raw} |
image-to-text, vlm
|
vlm |
image/input/url
|
{text, raw} |
asr, speech-to-text
|
asr |
audio/input/url
|
{text, chunks?, raw} |
zero-shot-image |
zero-shot-image |
image, labels
|
{labels, raw} |
language-id |
language-id |
audio/input/url
|
{labels, raw} |
audio.classify, audio-classification
|
audio-classification |
audio/input/url
|
{labels, raw} |
ocr |
ocr |
image/input/url
|
{text, raw} |
document-layout |
document-layout |
image/input/url
|
{boxes, raw} |
table-detection |
table-detection |
image/input/url
|
{boxes, raw} |
document-qa |
document-qa |
image, question/query
|
{answers, raw} |
text.classify, text-classification
|
text-classification |
text/input
|
{labels, raw} |
ner, token-classification
|
ner |
text/input
|
{entities, raw} |
zero-shot-text, zero-shot-classification
|
zero-shot-text |
text, labels
|
{labels, raw} |
summarization, summarize
|
summarization |
text/input
|
{summary, raw} |
text2text, text2text-generation
|
text2text |
text/input
|
{text, raw} |
code, code.embed
|
code |
text/input
|
{features, raw} |
vector.add/search/delete/clear/stats |
vectorstorage |
unit + operation payload |
storage result |
rag.add/search/delete/clear/reindex/stats |
RAG |
unit + operation payload |
RAG result |
onnx.predict |
onnx/custom |
inputs |
custom ONNX output |
| Wrapper | Описание |
|---|---|
runtime.chat(...) |
shortcut для chat.completions |
runtime.embed(...) |
shortcut для embeddings |
runtime.client(...) |
OpenAI client, требует optional openai package |
unit.invoke(...) |
single-unit runtime invoke |
- xlocllm
- Quickstart
- About
- Functions Python
- Functions TypeScript
- Use cases
- Examples Python
- Examples TypeScript
- Shared GPU mode
-
Models catalog
- Models The best
- Models Full model list
- Models Use your model
- For native mode
- Models Native LLM tiny small
- Models Native LLM medium
- Models Native LLM large
- Models Native embedding
- Models Native reranker
- Models Native translator
- Models Native tts
- Models Native vlm
- Models Native asr
- Models Native ocr
- Models Native image-classification
- Models Native object-detection
- Models Native image-segmentation
- Models Native depth-estimation
- Models Native document-layout
- Models Native table-detection
- Models Native document-qa
- Models Native language-id
- Models Native audio-classification
- Models Native text-classification
- Models Native ner
- Models Native zero-shot-text
- Models Native summarization
- Models Native text2text
- Models Native code
- For webgpu mode
- For web mode
- Models Web LLM
- Models Web embedding
- Models Web reranker
- Models Web translator
- Models Web tts
- Models Web vlm
- Models Web asr
- Models Web ocr
- Models Web image-classification
- Models Web object-detection
- Models Web image-segmentation
- Models Web depth-estimation
- Models Web document-layout
- Models Web table-detection
- Models Web document-qa
- Models Web zero-shot-image
- Models Web language-id
- Models Web audio-classification
- Models Web text-classification
- Models Web ner
- Models Web zero-shot-text
- Models Web summarization
- Models Web text2text
- Models Web code
- Dev