We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent 46ca43d commit 968eebeCopy full SHA for 968eebe
2 files changed
examples/server/README.md
@@ -40,6 +40,7 @@ options:
40
-l LANG, --language LANG [en ] spoken language ('auto' for auto-detect)
41
-dl, --detect-language [false ] exit after automatically detecting language
42
--prompt PROMPT [ ] initial prompt
43
+ --carry-initial-prompt [false ] always prepend initial prompt
44
-m FNAME, --model FNAME [models/ggml-base.en.bin] model path
45
-oved D, --ov-e-device DNAME [CPU ] the OpenVINO device used for encode inference
46
-dtw MODEL --dtw MODEL [ ] compute token-level timestamps
@@ -78,6 +79,8 @@ curl 127.0.0.1:8080/inference \
78
79
-F file="@<file-path>" \
80
-F temperature="0.0" \
81
-F temperature_inc="0.2" \
82
+-F prompt="<prompt>" \
83
+-F carry_initial_prompt="true" \
84
-F response_format="json"
85
```
86
0 commit comments