❓ Why in run_squad.py using XLNet, CLS token is not set at the end ?

[astariul]

❓ Questions & Help

This line of the file run_squad.py create the features for the dataset.

No matter which model is used (BERT or XLNet), the function will create the format :

CLS A SEP B SEP

But for XLNet case, we want :

A SEP B SEP CLS

---

Isn' it wrong ? Did I miss something ?

[thomwolf]

Humm I think you are right.

The SquAD example looks a bit broken in pytorch-transformers, we will have to review it @LysandreJik.

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.