Pretrain script

[bujiahao]

Hi,
Thanks for the great work!
Do u plan to provide the pretrain code and script?

[yumeng5]

Hi @bujiahao ,

We will not release the full pretraining code since that part involves copyright issues of other technologies within the company. Would you take a look at this issue which provides some important function skeletons of pretraining? I hope that would be helpful.

Best,
Yu

[bujiahao]

Hi @bujiahao ,

We will not release the full pretraining code since that part involves copyright issues of other technologies within the company. Would you take a look at this issue which provides some important function skeletons of pretraining? I hope that would be helpful.

Best, Yu

Thanks for ur reply
I will take a look