Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
Expand Up @@ -468,6 +468,7 @@ def import_data():
# top_p=0.9,
# system_prompt="You are a helpful assistant"
# avoid_commentary=True,
# knowledge=["Custom knowledge override", "Additional context"],
)
# highlight-end
# Additional parameters not shown
Expand Down Expand Up @@ -496,6 +497,7 @@ def import_data():
# top_p=0.9,
# system_prompt="You are a helpful assistant"
# avoid_commentary=True,
# knowledge=["Custom knowledge override", "Additional context"],
),
# Additional parameters not shown
# highlight-end
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -421,6 +421,7 @@ await client.collections.create({
// topP: 0.9,
// systemPrompt: 'You are a helpful assistant',
// avoidCommentary: true,
// knowledge: ['Custom knowledge override', 'Additional context'],
}),
// highlight-end
// Additional parameters not shown
Expand All @@ -439,6 +440,7 @@ response = await myCollection.generate.nearText("A holiday film", {
// topP: 0.9,
// systemPrompt: 'You are a helpful assistant',
// avoidCommentary: true,
// knowledge: ['Custom knowledge override', 'Additional context'],
}),
// highlight-end
}, {
Expand Down
17 changes: 9 additions & 8 deletions docs/weaviate/model-providers/contextualai/generative.md
Original file line number Diff line number Diff line change
Expand Up @@ -160,16 +160,17 @@ Configure the following generative parameters to customize the model behavior.

</Tabs>

For further details on model parameters, see the [Contextual AI API documentation](https://docs.contextual.ai/).
For further details on model parameters, see the [Contextual AI API documentation](https://docs.contextual.ai/api-reference/generate/generate).

If a parameter is not specified, Weaviate uses the server-side default for that parameter. They are documented below.
If a parameter is not specified, Weaviate uses the server-side default for that parameter. They are:

- `DefaultContextualAIModel` = `"v2"`
- `DefaultContextualAITemperature` = `0.0`
- `DefaultContextualAITopP` = `0.9`
- `DefaultContextualAIMaxNewTokens` = `1024`
- `DefaultContextualAISystemPrompt` = `""`
- `DefaultContextualAIAvoidCommentary` = `false`
- model = `"v2"`
- temperature = `0.0`
- topP = `0.9`
- maxNewTokens = `1024`
- systemPrompt = `""`
- avoidCommentary = `false`
- knowledge = `nil`

## Select a model at runtime

Expand Down
6 changes: 4 additions & 2 deletions docs/weaviate/model-providers/contextualai/reranker.md
Original file line number Diff line number Diff line change
Expand Up @@ -108,9 +108,9 @@ Configure a Weaviate collection to use a Contextual AI reranker model as follows

</Tabs>

### Select a model
### Reranker parameters

You can specify one of the [available models](#available-models) for Weaviate to use, as shown in the following configuration example:
Configure the reranker behavior, including the model to use, through the following parameters:

<Tabs className="code" groupId="languages">
<TabItem value="py" label="Python">
Expand All @@ -135,6 +135,8 @@ You can specify one of the [available models](#available-models) for Weaviate to

The [default model](#available-models) is used if no model is specified.

For further details on model parameters, see the [Contextual AI API documentation](https://docs.contextual.ai/api-reference/rerank/rerank).

## Header parameters

You can provide the API key as well as some optional parameters at runtime through additional headers in the request. The following headers are available:
Expand Down