rename

zheyuye · Jun 30, 2020 · 74178e2 · 74178e2
1 parent fa011aa
commit 74178e2
Show file tree

Hide file tree

Showing 2 changed files with 1 addition and 1 deletion.
diff --git a/scripts/pretraining/README.md b/scripts/pretraining/README.md
@@ -3,7 +3,7 @@
 Following the instruction of [Prepare OpenWebTextCorpus](../datasets/pretrain_corpus#openwebtext), download and prepare the dataset, obtaining a total of 20610 text files in the folder `prepared_owt`.
 
 ```bash
-python preprocesse_owt.py --input prepared_owt --output preprocessed_owt --max_seq_length 128
+python data_preprocessing.py --input prepared_owt --output preprocessed_owt --max_seq_length 128
 ```
 The above command allows us to generate the preprocessed Numpy features saved in `.npz`.
 # Pretrain Model

diff --git a/scripts/pretraining/preprocesse_owt.py → scripts/pretraining/data_preprocessing.py b/scripts/pretraining/preprocesse_owt.py → scripts/pretraining/data_preprocessing.py