diff --git a/docs/docs/features/load-unload.md b/docs/docs/features/load-unload.md index ca3980069..1e404a351 100644 --- a/docs/docs/features/load-unload.md +++ b/docs/docs/features/load-unload.md @@ -75,4 +75,5 @@ In case you got error while loading models. Please check for the correct model p | `user_prompt` | String | The prompt to use for the user. | | `ai_prompt` | String | The prompt to use for the AI assistant. | | `system_prompt` | String | The prompt for system rules. | -| `pre_prompt` | String | The prompt to use for internal configuration. | \ No newline at end of file +| `pre_prompt` | String | The prompt to use for internal configuration. | +|`clean_cache_threshold`| Integer| Number of chats that will trigger clean cache action.| \ No newline at end of file diff --git a/docs/openapi/NitroAPI.yaml b/docs/openapi/NitroAPI.yaml index a2b25940c..a8aaeb422 100644 --- a/docs/openapi/NitroAPI.yaml +++ b/docs/openapi/NitroAPI.yaml @@ -260,6 +260,11 @@ components: default: "ASSISTANT:" nullable: true description: The prefix for assistant prompt. + clean_cache_threshold: + type: integer + default: 5 + nullable: true + description: Number of chats that will trigger clean cache action. required: - llama_model_path