Skip to content

Commit

Permalink
chore: update docs (#684)
Browse files Browse the repository at this point in the history
* chore: update docs

* chore: update changelog
  • Loading branch information
numb3r3 committed Apr 18, 2022
1 parent 11487ce commit ec3a700
Show file tree
Hide file tree
Showing 2 changed files with 15 additions and 3 deletions.
12 changes: 12 additions & 0 deletions docs/changelog/index.md
Expand Up @@ -4,3 +4,15 @@ CLIP-as-service follows semantic versioning. However, before the project reach 1

This chapter only tracks the most important breaking changes and explain the rationale behind them.

## 0.2.0: improve the service scalability with replicas

This change is mainly intended to improve the inference performance with replicas.

Here is the short benchmark summary of the improvement (`replicas=4`):

| batch_size | before | after |
|-------------|--------|---------|
| 1 | 23.74 | 18.89 |
| 8 | 58.88 | 30.38 |
| 16 | 14.96 | 91.86 |
| 32 | 14.78 | 101.75 |
6 changes: 3 additions & 3 deletions docs/user-guides/server.md
Expand Up @@ -184,9 +184,9 @@ There are also runtime-specific parameters listed below:

````{tab} ONNX
| Parameter | Description |
|-----------|---------------------------------------------------------------------------------------------------|
| `providers` | [ONNX runtime provides](https://onnxruntime.ai/docs/execution-providers/), default is auto-detect |
| Parameter | Description |
|-----------|--------------------------------------------------------------------------------------------------------------------------------|
| `device` | `cuda` or `cpu`. Default is `None` means auto-detect.
````

Expand Down

0 comments on commit ec3a700

Please sign in to comment.