Support Gymnasium 0.29

[LucasAlegre]

No description provided.

[LucasAlegre]

@ffelten I had to replace EzPickle with RecordConstructorArgs in the LinearReward wrapper for the tests to pass. However, I'm not sure if we should also do that for the other wrappers?

[ffelten]

Hi Lucas,

Thanks for the PR 🤟

@ffelten I had to replace EzPickle with RecordConstructorArgs in the LinearReward wrapper for the tests to pass. However, I'm not sure if we should also do that for the other wrappers?

I think we should do this for all wrappers:

Gymnasium has implemented this for all built-in wrappers but for external projects, should be added to each wrapper. To do this, call gym.utils.RecordConstructorUtils.init(self, …) in the first line of the wrapper’s constructor with identical l keyword arguments as passed to the wrapper’s constructor, except for env.
https://gymnasium.farama.org/gymnasium_release_notes/#release-v0-28-0

Regarding the PR in general:

• We should bump the Gymnasium version in pyproject and probably in the testing workflow?
• A PR linked to this should be done in baselines to at least test the bump on the algorithms.

I can find some time to help if needed.