Text transformer tutorial doesn't work with the latest transformer version

[shamanez]

🐛 Bug

This text transformer tutorial fails with the transformers==4.31.0 version

and works fine with transformers==4.27.0 and bellow

To Reproduce

Run the notebook

Error:
"  File "/opt/conda/envs/cb-ml/lib/python3.10/site-packages/torch/autograd/__init__.py", line 200, in backward
    Variable._execution_engine.run_backward(  # Calls into the C++ engine to run the backward pass
RuntimeError: element 0 of tensors does not require grad and does not have a grad_fn
Epoch 0:   0%|          | 0/32 [00:01<?, ?it/s] "

[Borda]

Any thoughts on what could be the root of this issue? So far you refer to Torch so not sure how this can be fixed in lightning...

[Borda]

the latest build is with transformers==4.43.1 so I believe this was resolved 🦩
https://github.com/Lightning-AI/tutorials/blob/publication/.notebooks/lightning_examples/text-transformers.yaml