[BEIT3] Code for Pretraining BEIT-3

[gecgomes]

First of all, thank you for the amazing work on BEIT-3!

I have been exploring the repository and found the script run_beit3_finetuning.py for fine-tuning the model. However, I was unable to locate a corresponding script for pretraining, such as a run_beit3_pretraining.py.

Could you please clarify if the pretraining code is available? If not, is there any plan to release it in the future?

Thanks again for your work and looking forward to your response!