Missing all.tok file when running data/github/preprocessing/preprocess.py

[kdwedage]

I have downloaded the Java and Python Github data as outlined in the readme. I have attempted to run the preprocessing script following the command

python -m preprocessing.preprocess \ path_2_github_data \ --lang1 java \ --lang2 python \ --test_size 10000;

Upon completion I get the following error:
FileNotFoundError: [Errno 2] No such file or directory: '../../../path_2_github_data/java/all.tok'

While the directory '../../../path_2_github_data/java/' does exist, I can confirm that the all.tok does not.