Skip to content

Documentation

Raphael Waltenspül edited this page Apr 17, 2024 · 34 revisions

Introduction

Structure

Setup

Ingest

Query

Pipeline Components

Enumerator

Decoder

Segmenter

flowchart LR
 p[ ] --Retrievable--> Segmenter --Retrievable--> s[ ]
 style p fill:#0000,stroke:#0000,stroke-width:0px
 style s fill:#0000,stroke:#0000,stroke-width:0px
Loading

PassThroughSegmenter

The PassThroughSegmenter

"pass": {
   "type": "SEGMENTER",
   "factory": "PassThroughSegmenter"
}

FixedDurationSegmenter

The FixedDurationSegmenter

flowchart LR
 p  --> FixedDurationSegmenter --> s
Loading
"seg": {
   "type": "SEGMENTER",
   "factory": "FixedDurationSegmenter",
   "parameters": {
      "duration": "10",
      "lookAheadTime": "1"
   }
}

Aggregator

flowchart LR
 p[ ] --Retrievable--> Aggregator --Retrievable--> s[ ]
 style p fill:#0000,stroke:#0000,stroke-width:0px
 style s fill:#0000,stroke:#0000,stroke-width:0px
Loading

The 'AllContentAggregator'

"allContent": {
   "type": "AGGREGATOR",
   "factory": "AllContentAggregator"
}

Extractor

Exporter

Clone this wiki locally