veld_chain__demo_nlp_generic_preprocessing

** work in progress **

This repo contains chain velds encapsulating REPLACE

requirements

git
docker compose (note: older docker compose versions require running docker-compose instead of docker compose)

Clone this repo with all its submodules

git clone --recurse-submodules REPLACE

The following chain velds were used. Open the respective veld yaml file for more information.

REPLACE

docker compose -f veldREPLACE.yaml up

The test data at [./data/demo_01/in/grimms_fairy_tales.txt] (./data/demo_01/in/grimms_fairy_tales.txt) was provided by https://www.gutenberg.org/ .

Name		Name	Last commit message	Last commit date
Latest commit History 36 Commits
code		code
data		data
.gitignore		.gitignore
.gitmodules		.gitmodules
LICENSE		LICENSE
README.md		README.md
test.sh		test.sh
veld_demo_1_regex_replace.yaml		veld_demo_1_regex_replace.yaml
veld_demo_2_split_sentences.yaml		veld_demo_2_split_sentences.yaml
veld_demo_3_clean.yaml		veld_demo_3_clean.yaml
veld_demo_4_lemmatize.yaml		veld_demo_4_lemmatize.yaml
veld_demo_5_remove_punctuation.yaml		veld_demo_5_remove_punctuation.yaml
veld_demo_6_remove_whitespace.yaml		veld_demo_6_remove_whitespace.yaml
veld_demo_7_change_case.yaml		veld_demo_7_change_case.yaml
veld_demo_8_sample.yaml		veld_demo_8_sample.yaml
veld_demo_all.yaml		veld_demo_all.yaml