Compatibility with latest Huggingface implementation of Longformers?

[MarkusSagen]

Hi! I've been running the convert_model_to_long.ipynb and works great with 🤗 transformers 3.0.2.
When upgrading to the latest version of Huggingface (3.5.1), the notebook doesn’t t work and they’ve seem to changed their implementation of the Longformer and LongformerSelfAttention

Is there an easy way change the RobertaLongSelfAttention to the current Huggingface implementation or plans for updataing the notebook?
Following hitskyer, the dimensions becomes correct, but I don't know how to proceed and change the old forward pass into This.

[ibeltagy]

Unlikely that we will find time to update the notebook, but PRs are really appreciated.

[adamwawrzynski]

I've added PR with updated RoBERTa conversion script in transformers v4.2.0.