We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent e12baca commit a5ed223Copy full SHA for a5ed223
ChatQnA/docker/gaudi/README.md
@@ -306,7 +306,7 @@ curl http://${host_ip}:8008/generate \
306
307
```bash
308
#vLLM Service
309
-curl http://${your_ip}:8008/v1/completions \
+curl http://${host_ip}:8008/v1/completions \
310
-H "Content-Type: application/json" \
311
-d '{
312
"model": "${LLM_MODEL_ID}",
@@ -318,7 +318,7 @@ curl http://${your_ip}:8008/v1/completions \
318
319
320
#vLLM-on-Ray Service
321
-curl http://${your_ip}:8008/v1/chat/completions \
+curl http://${host_ip}:8008/v1/chat/completions \
322
323
-d '{"model": "${LLM_MODEL_ID}", "messages": [{"role": "user", "content": "What is Deep Learning?"}]}'
324
```
0 commit comments