Skip to content
This repository was archived by the owner on Jun 3, 2025. It is now read-only.
Merged
Changes from all commits
Commits
Show all changes
28 commits
Select commit Hold shift + click to select a range
a071ac5
add megasparse dir
InquestGeronimo Apr 5, 2022
1d7712a
edited readme to support DS integration
InquestGeronimo Apr 5, 2022
9db5ca8
small edit to docstring
InquestGeronimo Apr 5, 2022
47bfdbb
edited settings.py module so only 2 models are loaded.
InquestGeronimo Apr 5, 2022
9eea303
added more context to the readme about adding more models.
InquestGeronimo Apr 5, 2022
03bc62e
fixed image
InquestGeronimo Apr 5, 2022
dc09979
added different host to streamlit client as default
InquestGeronimo Apr 5, 2022
d1ec856
quality check edits
InquestGeronimo Apr 5, 2022
5f26aae
quality check commit
InquestGeronimo Apr 5, 2022
970e9dd
passing copyright quality check
InquestGeronimo Apr 5, 2022
a7fe2fb
content edits
InquestGeronimo Apr 5, 2022
21ccf50
delete megapsparse
InquestGeronimo Apr 5, 2022
242d54f
add sparsestream dir to exaamples folder
InquestGeronimo Apr 5, 2022
71fae3e
quality check edits
InquestGeronimo Apr 5, 2022
32f0a24
set dependency pins
InquestGeronimo Apr 7, 2022
f8a55dc
changed data.py module name
InquestGeronimo Apr 7, 2022
090a6ce
changed data.py module name
InquestGeronimo Apr 7, 2022
1115b59
Merge branch 'main' into sparsestream
InquestGeronimo Apr 7, 2022
c2eaacf
Merge https://github.com/InquestGeronimo/deepsparse into sparsestream
InquestGeronimo Apr 7, 2022
8decd48
Merge branch 'sparsestream' of https://github.com/InquestGeronimo/dee…
InquestGeronimo Apr 7, 2022
9efa5b8
commented out filter
InquestGeronimo Apr 7, 2022
5ef6118
changed location of get tokens func
InquestGeronimo Apr 7, 2022
8dbef46
style update
InquestGeronimo Apr 7, 2022
f120dee
fixes for get_tokens func
InquestGeronimo Apr 7, 2022
ad56a37
delete util.py
InquestGeronimo Apr 7, 2022
30cb15b
updated model stubs
InquestGeronimo Apr 7, 2022
2a19a8d
delete sparsestream dir
InquestGeronimo Apr 8, 2022
5230bbc
Merge branch 'main' into update-stubs
InquestGeronimo Apr 8, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions src/deepsparse/server/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -50,7 +50,7 @@ Example CLI command for serving a single model for the **question answering** ta
```bash
deepsparse.server \
--task question_answering \
--model_path "zoo:nlp/question_answering/bert-base/pytorch/huggingface/squad/pruned_quant-aggressive_95"
--model_path "zoo:nlp/question_answering/bert-base/pytorch/huggingface/squad/12layer_pruned80_quant-none-vnni"
```

To make a request to your server, you can use the `requests` library and pass the request URL:
Expand Down Expand Up @@ -96,7 +96,7 @@ models:
batch_size: 1
alias: question_answering/base
- task: question_answering
model_path: zoo:nlp/question_answering/bert-base/pytorch/huggingface/squad/pruned_quant-aggressive_95
model_path: zoo:nlp/question_answering/bert-base/pytorch/huggingface/squad/12layer_pruned80_quant-none-vnni
batch_size: 1
alias: question_answering/pruned_quant
```
Expand Down