Add inference_mode back to image_segmentation

[Narsil]

Environment info

This hotfix: #14204 could be superseeded with superior fix that would keep inference_mode by hiding the tensor inplace modifications behind if self.training.

Who can help

Information

Model I am using (Bert, XLNet ...):

The problem arises when using:

• the official example scripts: (give details below)
• my own modified scripts: (give details below)

The tasks I am working on is:

• an official GLUE/SQUaD task: (give the name)
• my own task or dataset: (give details below)

To reproduce

Steps to reproduce the behavior:

Expected behavior

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

[Narsil]

Was fixed by #14260