From 436da0f3749d84c6bceedc02eabc2c4fec53bddf Mon Sep 17 00:00:00 2001 From: automaticcat Date: Mon, 11 Dec 2023 15:29:58 +0700 Subject: [PATCH 1/2] Update README.md --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index c581c4092..fe445a24e 100644 --- a/README.md +++ b/README.md @@ -108,7 +108,7 @@ Table of parameters | `pre_prompt` | String | The prompt to use for internal configuration. | | `cpu_threads` | Integer | The number of threads to use for inferencing (CPU MODE ONLY) | | `n_batch` | Integer | The batch size for prompt eval step | - +| `caching_enabled` | Boolean | To enable prompt caching or not | ***OPTIONAL***: You can run Nitro on a different port like 5000 instead of 3928 by running it manually in terminal ```zsh ./nitro 1 127.0.0.1 5000 ([thread_num] [host] [port]) From 2721a821f2c46b02cbd8e19abd0684680bd85bef Mon Sep 17 00:00:00 2001 From: automaticcat Date: Mon, 11 Dec 2023 15:30:16 +0700 Subject: [PATCH 2/2] Update README.md --- README.md | 1 + 1 file changed, 1 insertion(+) diff --git a/README.md b/README.md index fe445a24e..3272fb249 100644 --- a/README.md +++ b/README.md @@ -109,6 +109,7 @@ Table of parameters | `cpu_threads` | Integer | The number of threads to use for inferencing (CPU MODE ONLY) | | `n_batch` | Integer | The batch size for prompt eval step | | `caching_enabled` | Boolean | To enable prompt caching or not | + ***OPTIONAL***: You can run Nitro on a different port like 5000 instead of 3928 by running it manually in terminal ```zsh ./nitro 1 127.0.0.1 5000 ([thread_num] [host] [port])