Skip to content

Commit 968eebe

Browse files
authored
server: add support for carry_initial_prompt (#3781)
* Add support for carry_initial_prompt on the server * Update README
1 parent 46ca43d commit 968eebe

2 files changed

Lines changed: 147 additions & 143 deletions

File tree

examples/server/README.md

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -40,6 +40,7 @@ options:
4040
-l LANG, --language LANG [en ] spoken language ('auto' for auto-detect)
4141
-dl, --detect-language [false ] exit after automatically detecting language
4242
--prompt PROMPT [ ] initial prompt
43+
--carry-initial-prompt [false ] always prepend initial prompt
4344
-m FNAME, --model FNAME [models/ggml-base.en.bin] model path
4445
-oved D, --ov-e-device DNAME [CPU ] the OpenVINO device used for encode inference
4546
-dtw MODEL --dtw MODEL [ ] compute token-level timestamps
@@ -78,6 +79,8 @@ curl 127.0.0.1:8080/inference \
7879
-F file="@<file-path>" \
7980
-F temperature="0.0" \
8081
-F temperature_inc="0.2" \
82+
-F prompt="<prompt>" \
83+
-F carry_initial_prompt="true" \
8184
-F response_format="json"
8285
```
8386

0 commit comments

Comments
 (0)