cannot train ma-gym environment with IQL

[Nafisanaznin]

Hello there!
I am trying to train environments with IQL. But I think I am doing something wrong. The add_new_env.py file utilizes ma-gym environment and trains that with mappo. But when I write iql instead of mappo it doesn't work. I have tried to solve it but wasn't able to. I think there is something I am missing.
Thanks in advance.

[Theohhhu]

Could you please provide me with the complete error tracing log?

[Nafisanaznin]

sure. I am running the add_new_env.py file. And I have replaced mappo with iql. And the error log is the following,

[Aequatio-Space]

I met a similar issue. To solve it, import a different ENV_REGISTRY
from marllib.envs.global_reward_env import COOP_ENV_REGISTRY as ENV_REGISTRY
instead of
from marllib.envs.base_env import ENV_REGISTRY

This Is because IQL algorithm is a (fake) VD network that uses run_vd.py to run, when it imports the ENV_REGISTRY, it comes from global_reward_env.

MARLlib/marllib/marl/algos/run_vd.py

Line 30 in 368c617

from marllib.envs.global_reward_env import COOP_ENV_REGISTRY as ENV_REGISTRY

In this add_new_env.py however, the ENV_REGISTRY comes from base_env.

MARLlib/examples/add_new_env.py

Line 40 in 368c617

from marllib.envs.base_env import ENV_REGISTRY

[Nafisanaznin]

Thank you very much for your reply. But for some reason after replacing that line its telling me that my environment is not registered. Do I have to change something in my config file? Thanks in advance.

[Aequatio-Space]

Thank you very much for your reply. But for some reason after replacing that line its telling me that my environment is not registered. Do I have to change something in my config file? Thanks in advance.

You can try to register both environment in the registries (base_env and global_reward_env). Also, If you can kindly provide the specific error screenshot you have encountered, I may get a better understanding of what's going on :)

[Nafisanaznin]

I solved it afterwards. I had to change the init.py file in the marl folder. I had to make the ENV_REGISTRY as COOP_ENV_REGISTRY. After that it worked. Thanks for your help though!