From 188deb36cec471d3cd17b3b16ad476ba73f52eac Mon Sep 17 00:00:00 2001 From: hahuyhoang411 Date: Wed, 24 Jan 2024 11:34:52 +0700 Subject: [PATCH] add(mlock): update mlock docs --- README.md | 1 + docs/docs/features/load-unload.md | 3 ++- 2 files changed, 3 insertions(+), 1 deletion(-) diff --git a/README.md b/README.md index 5ef50aee4..0fc99bd96 100644 --- a/README.md +++ b/README.md @@ -127,6 +127,7 @@ Table of parameters | `clean_cache_threshold` | Integer | Number of chats that will trigger clean cache action| |`grp_attn_n`|Integer|Group attention factor in self-extend| |`grp_attn_w`|Integer|Group attention width in self-extend| +|`mlock`|Boolean|Prevent system swapping of the model to disk in macOS| ***OPTIONAL***: You can run Nitro on a different port like 5000 instead of 3928 by running it manually in terminal ```zsh diff --git a/docs/docs/features/load-unload.md b/docs/docs/features/load-unload.md index 22b20340f..fb22360e4 100644 --- a/docs/docs/features/load-unload.md +++ b/docs/docs/features/load-unload.md @@ -79,4 +79,5 @@ In case you got error while loading models. Please check for the correct model p | `pre_prompt` | String | The prompt to use for internal configuration. | |`clean_cache_threshold`| Integer| Number of chats that will trigger clean cache action.| |`grp_attn_n`|Integer|Group attention factor in self-extend| -|`grp_attn_w`|Integer|Group attention width in self-extend| \ No newline at end of file +|`grp_attn_w`|Integer|Group attention width in self-extend| +|`mlock`|Boolean|Prevent system swapping of the model to disk in macOS| \ No newline at end of file