You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: content/operate/rc/langcache/create-service.md
+5-5Lines changed: 5 additions & 5 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -26,7 +26,7 @@ LangCache does not support the following databases during public preview:
26
26
- Databases with the [default user]({{< relref "/operate/rc/security/access-control/data-access-control/default-user" >}}) turned off
27
27
{{< /note >}}
28
28
29
-
- An [OpenAI API key](https://platform.openai.com/api-keys). LangCache uses OpenAI to generate embeddings for prompts and responses.
29
+
- An API key for your embedding provider, if not using the default Redis embedding provider. LangCache supports [OpenAI](https://platform.openai.com/api-keys) and the Redis embedding provider during public preview.
30
30
31
31
## Create a LangCache service
32
32
@@ -67,10 +67,10 @@ The **Embedding settings** section defines the embedding model used by your serv
67
67
68
68
| Setting name |Description|
69
69
|:----------------------|:----------|
70
-
|**Supported Embedding Provider**| The embedding provider to use for your service. LangCache only supports OpenAI during public preview. |
71
-
|**Embedding provider API key**| Enter your embedding provider's API key. |
70
+
|**Embedding Provider**| The embedding provider to use for your service. Select between `Redis` and `OpenAI`. |
71
+
|**Embedding provider API key**| Enter your embedding provider's API key if not using the default Redis embedding provider. |
72
72
|**Model**| Select the embedding model to use for your service. |
73
-
|**Similarity threshold**| Set the minimum similarity score required to consider a cached response a match. Range: `0.5` to `1.0`. Default: `0.9`<br/><br/>A higher value means more precise matches, but if it's too high, you will compromise on the number of matches and may lose relevant matches. A lower value means more matches, but may include less relevant matches. We recommend starting between `0.8` and `0.9` and then fine-tuning based on your results. |
73
+
|**Similarity threshold**| Set the minimum similarity score required to consider a cached response a match. Range: `0.5` to `1.0`. Default: `0.85`<br/><br/>A higher value means more precise matches, but if it's too high, you will compromise on the number of matches and may lose relevant matches. A lower value means more matches, but may include less relevant matches. We recommend starting between `0.8` and `0.9` and then fine-tuning based on your results. |
74
74
75
75
### Attributes settings
76
76
@@ -111,7 +111,7 @@ A window containing your LangCache service key will appear. Select **Copy** to c
111
111
{{<warning>}}
112
112
This is the only time the value of the user key is available. Save it to a secure location before closing the dialog box.<br/><br/>
113
113
114
-
If you lose the service key value, you will need to [replace the service key]({{< relref "/operate/rc/langcache/view-edit-cache#replace-service-api-key" >}}) to be able to use the LangCache API.
114
+
If you lose the service key value, you will need to [generate a new service key]({{< relref "/operate/rc/langcache/view-edit-cache#replace-service-api-key" >}}) to be able to use the LangCache API.
115
115
{{</warning>}}
116
116
117
117
You'll be taken to your LangCache service's **Configuration** page. You'll also be able to see your LangCache service in the LangCache service list.
Copy file name to clipboardExpand all lines: content/operate/rc/langcache/view-edit-cache.md
+11-7Lines changed: 11 additions & 7 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -39,17 +39,17 @@ The **Connectivity** section provides the connection details for your LangCache
39
39
|**Cache ID**| The unique ID of your LangCache service. |
40
40
|**API Base URL**| The base URL for LangCache API requests. |
41
41
42
-
Select the **Copy** button next to the Cache ID and API Base URL to copy them to the clipboard. If you lost the API key value or need to rotate the key, you can [replace the service API key](#replace-service-api-key) at any time.
42
+
Select the **Copy** button next to the Cache ID and API Base URL to copy them to the clipboard. If you lost the API key value or need to rotate the key, you can [generate a new service API key](#replace-service-api-key) at any time.
43
43
44
44
See [use the LangCache API]({{< relref "/operate/rc/langcache/use-langcache" >}}) for more information on how to use these values.
45
45
46
-
#### Replace service API key
46
+
#### Generate a new service API key {#replace-service-api-key}
47
47
48
-
The API key is only available immediately after you create the LangCache service. If you lost this value, or need to rotate the key, you can replace the service key at any time.
48
+
The API key is only available immediately after you create the LangCache service. If you lost this value, or need to rotate the key, you can generate a new service key at any time.
{{<imagefilename="images/rc/langcache-service-key.png"alt="The LangCache service key window. Use the Copy button to save the service key to the clipboard." >}}
61
61
62
62
{{<warning>}}
63
+
After you generate a new service key, calls to the LangCache API with the old key will fail. <br/><br/>
64
+
63
65
This is the only time the value of the user key is available. Save it to a secure location before closing the dialog box. <br/><br/>
64
66
65
-
If you lose the service key value, you will need to replace the key again.
67
+
If you lose the service key value, you will need to generate a new key again.
66
68
{{</warning>}}
67
69
68
70
### General
@@ -77,7 +79,9 @@ The **General** section provides configuration details for your LangCache servic
77
79
|**Database**| The database that stores your cache data. |
78
80
|**Similarity threshold**| The minimum similarity score required to consider a cached response a match. _(Editable)_|
79
81
|**TTL**| The number of seconds to cache entries before they expire. _(Editable)_|
80
-
|**Embedding Provider**| The embedding provider to use for your service. |
82
+
|**Embedding Provider**| The embedding provider used for your service. |
83
+
|**Embedding Model**| The embedding model used for your service. |
84
+
|**Embedding Model API key**| The obfuscated API key for the embedding provider. |
81
85
82
86
Some of these settings can be changed after cache creation. To do so, select the **Edit** button.
0 commit comments