190K data

[manojitrtc1in]

Where can I find the codeup_190k.json file ? I want to do the training with this data. Thanks.

[juyongjiang]

@manojitrtc1in Sorry for the late reply. I filter the existing data from the Hugging Face to gain codeup_190k.json. You can download the original 200k data from here (https://huggingface.co/datasets/rombodawg/Legacy_MegaCodeTraining200k).

Then, run the following command to obtain higher-quality instruction data, i.e., codeup_190k.json (I don't put it in GitHub due to its large size).

cd data
python preprocess.py

[huliang2016]

Could you please share the data since rombodawg/Legacy_MegaCodeTraining200k is missing...