Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions specification/_types/mapping/ChunkingSettings.ts
Original file line number Diff line number Diff line change
Expand Up @@ -24,9 +24,9 @@ import { OverloadOf } from '@spec_utils/behaviors'
export class ChunkingSettings implements OverloadOf<InferenceChunkingSettings> {
strategy: string

separator_group: string
separator_group?: string

separators: string[]
separators?: string[]

max_chunk_size: integer

Expand Down
10 changes: 6 additions & 4 deletions specification/inference/_types/Services.ts
Original file line number Diff line number Diff line change
Expand Up @@ -310,24 +310,26 @@ export class InferenceChunkingSettings {
*/
sentence_overlap?: integer
/**
* This parameter is only applicable when using the `recursive` chunking strategy.
* Only applicable to the `recursive` strategy and required when using it.
*
* Sets a predefined list of separators in the saved chunking settings based on the selected text type.
* Values can be `markdown` or `plaintext`.
*
* Using this parameter is an alternative to manually specifying a custom `separators` list.
*/
separator_group: string
separator_group?: string
/**
* A list of strings used as possible split points when chunking text with the `recursive` strategy.
* Only applicable to the `recursive` strategy and required when using it.
*
* A list of strings used as possible split points when chunking text.
*
* Each string can be a plain string or a regular expression (regex) pattern.
* The system tries each separator in order to split the text, starting from the first item in the list.
*
* After splitting, it attempts to recombine smaller pieces into larger chunks that stay within
* the `max_chunk_size` limit, to reduce the total number of chunks generated.
*/
separators: string[]
separators?: string[]
/**
* The chunking strategy: `sentence`, `word`, `none` or `recursive`.
*
Expand Down