About the BERT

[shuxiaobo]

Hi, Thanks for your code, I replace the XLNet with BERT using the original hyper-parameter, get very very bad result. Did you ever try the BERT model instead of XLNet?

[huiyegit]

I did try BERT before. Bert can achieve similar results like XLNet. You might change the pipeline for Bert, i.e. tokenizer, hyperparameter.