Skip to content
Permalink
Browse files

fix(preprocessor): rename SentSplitPreprocessor

  • Loading branch information...
hanxiao committed Aug 29, 2019
1 parent 030d6c6 commit 522c5a4ebbe79fc17b49cbda1287d2487dcb45b5
@@ -280,7 +280,7 @@ Now let's see what the YAML config says. First impression, it is pretty intuitiv
<summary>Preprocessor config: text-prep.yml (click to expand...)</summary>

```yaml
!PunctSplitPreprocessor
!SentSplitPreprocessor
parameters:
start_doc_id: 0
random_doc_id: True
@@ -1,4 +1,4 @@
!PunctSplitPreprocessor
!SentSplitPreprocessor
parameters:
start_doc_id: 0
random_doc_id: True
@@ -1,4 +1,4 @@
!PunctSplitPreprocessor
!SentSplitPreprocessor
parameters:
start_doc_id: 0
random_doc_id: True
@@ -65,7 +65,7 @@ In this example, we define a `TorchvisionEncoder` that loads a pretrained VGG16
|`!CLS`| Component Type |
|---|---|
|`!BasePreprocessor`|Preprocessor|
|`!PunctSplitPreprocessor`|Preprocessor|
|`!SentSplitPreprocessor`|Preprocessor|
|`!BaseImagePreprocessor`|Preprocessor|
|`!BaseTextPreprocessor`|Preprocessor|
|`!VanillaSlidingPreprocessor`|Preprocessor|
@@ -214,7 +214,7 @@ Note that how we defines a map under `kwargs` to describe the arguments, they wi
The examples above are all about encoder. In fact, every component including encoder, preprocessor, router, indexer can all be described with YAML and loaded to GNES. For example,
```yaml
!PunctSplitPreprocessor
!SentSplitPreprocessor
parameters:
start_doc_id: 0
random_doc_id: True
@@ -1,4 +1,4 @@
!PunctSplitPreprocessor
!SentSplitPreprocessor
parameters:
start_doc_id: 0
random_doc_id: True

0 comments on commit 522c5a4

Please sign in to comment.
You can’t perform that action at this time.