-
|
Hello Everyone, Is there any solution for preparing data especially for Arabic, Turkish, English for transcription quicker than that. I've taken almost 5 hours and it was not prepared. |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
|
We can apply the data preparation function to all of our training examples using dataset's .map method. The argument num_proc specifies how many CPU cores to use. Setting num_proc > 1 will enable multiprocessing. If the .map method hangs with multiprocessing, set num_proc=1 and process the dataset sequentially. as mentioned in the fine-tune jupyter notebook |
Beta Was this translation helpful? Give feedback.
We can apply the data preparation function to all of our training examples using dataset's .map method. The argument num_proc specifies how many CPU cores to use. Setting num_proc > 1 will enable multiprocessing. If the .map method hangs with multiprocessing, set num_proc=1 and process the dataset sequentially. as mentioned in the fine-tune jupyter notebook