UnregisteredEnv #2
Comments
|
Hi, Yuanzhuo, thanks for your interest. If you are using Pycharm to run the code, maybe you can try to make the directory as the source directory. Feel free to let me know if you have other questions. |
|
Thanks! I have tried to do this before, but this error still occurs. In addition, I found this error when I checked and ran the file. |
|
Hi, Yuanzhuo, Thanks for your update. To test the code, please run the files, e.g., |
Sorry! My expression is not very clear. I run the 'run_mappo.py' actually, and make Directory as Source s Root as well. But tthere was the error 'gym.error.UnregisteredEnv: No registered env with id: merge-multi-agent-v0'. |
It seems you are running the environment file? Please also try to make both highway-env and MARL directories as source directories and then run the |
|
|
Thank you so much! Could you please try to run it via the right click instead of the command line? If you can see the output as follows, you are able to run the code. The error means there are no existing models. |
Thank you very much for your patience and solution！My output is similar to yours. I sincerely hope that your article can be accepted, and looking forward to your code open source. Good luck！ Best regards |
Thank you for your kind words. Also, I am welcome to further discussion and potential improvement for the paper. |
so when im running the file only ;it runs but wat to do further @DongChen06 |
|
so when im running the file only ;it runs but wat to do further @DongChen06 it'd be really helpful; if u can react to this @DongChen06 |
|
|
|
@siddarth-mp Hi are you still facing the unregistered issue or you are able to run it without outputting results? |
|
[image: image.png]
now im getting like this; however if i run single file like u said, it
runs and exits and by the way what does 'results' store; in my case it is
empty:
[image: image.png]
[image: image.png]
…On Tue, Apr 25, 2023 at 9:03 PM Dong Chen ***@***.***> wrote:
@siddarth-mp <https://github.com/siddarth-mp> Hi are you still facing the
unregistered issue or you are able to run it without outputting results?
—
Reply to this email directly, view it on GitHub
<#2 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AR2ZYI2EN5FJIU54Y4HU4GDXC7VFRANCNFSM47X6KHGQ>
.
You are receiving this because you were mentioned.Message ID:
***@***.***>
|
|
The figures are not shown correctly |
|
sorry about that, so if i run run_mappo: im getting "not registered error"
; when im running run_madqn : im getting like this :
…On Tue, Apr 25, 2023 at 9:22 PM Dong Chen ***@***.***> wrote:
The figures are not shown correctly
—
Reply to this email directly, view it on GitHub
<#2 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AR2ZYI4UOBOH6TEW5QR4FZDXC7XMZANCNFSM47X6KHGQ>
.
You are receiving this because you were mentioned.Message ID:
***@***.***>
|
|
And now even when i run individual files, im getting like this
(gymnasium.error.NameNotFound: Environment `merge-multi-agent` doesn't
exist.):
plz can u help
…On Tue, Apr 25, 2023 at 9:33 PM Siddarth Mp ***@***.***> wrote:
sorry about that, so if i run run_mappo: im getting "not registered error"
; when im running run_madqn : im getting like this :
On Tue, Apr 25, 2023 at 9:22 PM Dong Chen ***@***.***>
wrote:
> The figures are not shown correctly
>
> —
> Reply to this email directly, view it on GitHub
> <#2 (comment)>,
> or unsubscribe
> <https://github.com/notifications/unsubscribe-auth/AR2ZYI4UOBOH6TEW5QR4FZDXC7XMZANCNFSM47X6KHGQ>
> .
> You are receiving this because you were mentioned.Message ID:
> ***@***.***>
>
|
|
A Quick update (sorry for inconvenience)
while running run_madqn : 'gymnasium.error.NameNotFound: Environment
`merge-multi-agent` doesn't exist.'
while running run_mappo,run_maacktr : ERROR:root:Can not find checkpoint
for ./results/Apr_25_18_34_45/models/ ==> the new result folder under
which the model file is empty
…On Tue, Apr 25, 2023 at 10:21 PM Siddarth Mp ***@***.***> wrote:
And now even when i run individual files, im getting like this
(gymnasium.error.NameNotFound: Environment `merge-multi-agent` doesn't
exist.):
plz can u help
On Tue, Apr 25, 2023 at 9:33 PM Siddarth Mp ***@***.***> wrote:
> sorry about that, so if i run run_mappo: im getting "not registered
> error" ; when im running run_madqn : im getting like this :
>
> On Tue, Apr 25, 2023 at 9:22 PM Dong Chen ***@***.***>
> wrote:
>
>> The figures are not shown correctly
>>
>> —
>> Reply to this email directly, view it on GitHub
>> <#2 (comment)>,
>> or unsubscribe
>> <https://github.com/notifications/unsubscribe-auth/AR2ZYI4UOBOH6TEW5QR4FZDXC7XMZANCNFSM47X6KHGQ>
>> .
>> You are receiving this because you were mentioned.Message ID:
>> ***@***.***>
>>
>
|
|
For the MAPPO, it should be correct, just wait for some time and then you will see the results. |
|
Thanks a lot, MAPPO worked!!!, but how can i add different scenarios, coz
it keeps saying "gymnasium.error.NameNotFound: Environment
`merge-multi-agent` doesn't exist" (or) not registered for madqn,.., any
idea??
…On Wed, Apr 26, 2023 at 12:10 AM Dong Chen ***@***.***> wrote:
For the MAPPO, it should be correct, just wait for some time and then you
will see the results.
—
Reply to this email directly, view it on GitHub
<#2 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AR2ZYI3B432GTYIX3OQBCC3XDALB3ANCNFSM47X6KHGQ>
.
You are receiving this because you were mentioned.Message ID:
***@***.***>
|
|
Great! For MADQN, you may need to follow MAPPO or MAA2C to make some changes. I did not test MADQN. |
|
Hi, I just wanted to know, if u included Graph concepts ; coz our project
focuses on Graph Reinforcement learning; however i didnt find any graph
module in yours , if I'm wrong can u plz where have u used Graph concepts
;like we thought of encoding vehicle features through GCN and then apply
GRL and modify the environment accordingly; also what about the dataset,
like is it like ,the initial scenario of cars is taken as dataset and over
successive iteration it is fed back to algo?? can u clarify a bit on these
parts
Thanks
…On Wed, Apr 26, 2023 at 1:21 AM Dong Chen ***@***.***> wrote:
Great! For MADQN, you may need to follow MAPPO or MAA2C to make some
changes. I did not test MADQN.
—
Reply to this email directly, view it on GitHub
<#2 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AR2ZYI5RSUWO477ILNA4K73XDATLXANCNFSM47X6KHGQ>
.
You are receiving this because you were mentioned.Message ID:
***@***.***>
|
|
I just wanted to know what kind of communication have you used for cav's
for info sharing, and pls can can u reply abt previous mail.
…On Wed, 26 Apr, 2023, 7:31 pm Siddarth Mp, ***@***.***> wrote:
Hi, I just wanted to know, if u included Graph concepts ; coz our project
focuses on Graph Reinforcement learning; however i didnt find any graph
module in yours , if I'm wrong can u plz where have u used Graph concepts
;like we thought of encoding vehicle features through GCN and then apply
GRL and modify the environment accordingly; also what about the dataset,
like is it like ,the initial scenario of cars is taken as dataset and over
successive iteration it is fed back to algo?? can u clarify a bit on these
parts
Thanks
On Wed, Apr 26, 2023 at 1:21 AM Dong Chen ***@***.***>
wrote:
> Great! For MADQN, you may need to follow MAPPO or MAA2C to make some
> changes. I did not test MADQN.
>
> —
> Reply to this email directly, view it on GitHub
> <#2 (comment)>,
> or unsubscribe
> <https://github.com/notifications/unsubscribe-auth/AR2ZYI5RSUWO477ILNA4K73XDATLXANCNFSM47X6KHGQ>
> .
> You are receiving this because you were mentioned.Message ID:
> ***@***.***>
>
|
|
Hi Sir, just wanted to know if we can include concept of GNN in improvising
the better representation of vehicles, I'm working on a project which
mainly focuses on employing GRL (Graph reinforcement learning), we found
your's MARL CAV's idea of using Reinforcement Learning, however we found
you didn't employ GNN , and wondered how you achieved communication amongst
CAV's, so if we were to employ GNN in better representation through feature
embeddings, it'd be helpful, so any inputs from you would be considered,can
you please guide us through roadmap or some ideas.
With Regards,
Siddarth M.P
…On Thu, Apr 27, 2023 at 3:24 PM Siddarth Mp ***@***.***> wrote:
I just wanted to know what kind of communication have you used for cav's
for info sharing, and pls can can u reply abt previous mail.
On Wed, 26 Apr, 2023, 7:31 pm Siddarth Mp, ***@***.***> wrote:
> Hi, I just wanted to know, if u included Graph concepts ; coz our project
> focuses on Graph Reinforcement learning; however i didnt find any graph
> module in yours , if I'm wrong can u plz where have u used Graph concepts
> ;like we thought of encoding vehicle features through GCN and then apply
> GRL and modify the environment accordingly; also what about the dataset,
> like is it like ,the initial scenario of cars is taken as dataset and over
> successive iteration it is fed back to algo?? can u clarify a bit on these
> parts
>
> Thanks
>
> On Wed, Apr 26, 2023 at 1:21 AM Dong Chen ***@***.***>
> wrote:
>
>> Great! For MADQN, you may need to follow MAPPO or MAA2C to make some
>> changes. I did not test MADQN.
>>
>> —
>> Reply to this email directly, view it on GitHub
>> <#2 (comment)>,
>> or unsubscribe
>> <https://github.com/notifications/unsubscribe-auth/AR2ZYI5RSUWO477ILNA4K73XDATLXANCNFSM47X6KHGQ>
>> .
>> You are receiving this because you were mentioned.Message ID:
>> ***@***.***>
>>
>
|
|
Hi sidd, I think GRL is a good idea to improve the current approach. Since GNN is used for embedding layers, you may replace the feature extraction layers with GNN and keep other settings unchanged. For the network inputs, you may consider a fixed number of surrounding vehicles to simplify the problem and each neighbor can be considered as one node. |
|
Thanks for the feedback!
…On Fri, Jun 16, 2023 at 6:26 PM Dong Chen ***@***.***> wrote:
Hi sidd, I think GRL is a good idea to improve the current approach. Since
GNN is used for embedding layers, you may replace the feature extraction
layers with GNN and keep other settings unchanged. For the network inputs,
you may consider a fixed number of surrounding vehicles to simplify the
problem and each neighbor can be considered as one node.
—
Reply to this email directly, view it on GitHub
<#2 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AR2ZYI3AMUBFFW4IY4QIMZDXLRJYVANCNFSM47X6KHGQ>
.
You are receiving this because you were mentioned.Message ID:
***@***.***>
|
|
Hi,
1) We were implementing our GRL plan on your MARL project, so actually we
wanted to implement 'roundabout' scenario instead of 'merge-multi-agent-v0'
which you implemented, so in order to do so, according to highway-env
documentation in github, it says just use 'gym.make('roundabout')' and
register the scenario like:
register(
id='roundabout-v0',
entry_point='highway_env.envs.roundabout:RoundaboutEnv',
)
however, when i did so, an error occurred saying no module named
'RoundaboutEnv' in 'roundaboutenv' so do we need to create separate .py
file like the one u did as 'merge_multi_lane.py', describing how to
construct roads and merging structures, or is there any specific modules
like the one described in documentation
2) In order to spawn HDV,CAV you used a list of co-ordinates, so how was it
done using single axis, coz for our project in order to construct graph, we
need 2 axis simulation, so how does it work, i mean simulation coordinates,
how to refer it(rough plot) , can we describe in 2axis plot, so any idea on
it, in which how it goes in highway env
Thank you,
Siddarth
…On Sat, Jun 17, 2023 at 3:01 PM Siddarth Mp ***@***.***> wrote:
Thanks for the feedback!
On Fri, Jun 16, 2023 at 6:26 PM Dong Chen ***@***.***>
wrote:
> Hi sidd, I think GRL is a good idea to improve the current approach.
> Since GNN is used for embedding layers, you may replace the feature
> extraction layers with GNN and keep other settings unchanged. For the
> network inputs, you may consider a fixed number of surrounding vehicles to
> simplify the problem and each neighbor can be considered as one node.
>
> —
> Reply to this email directly, view it on GitHub
> <#2 (comment)>,
> or unsubscribe
> <https://github.com/notifications/unsubscribe-auth/AR2ZYI3AMUBFFW4IY4QIMZDXLRJYVANCNFSM47X6KHGQ>
> .
> You are receiving this because you were mentioned.Message ID:
> ***@***.***>
>
|
|
|
|
@ZhangTingyang Hi Tingyang, can you run other algos? Or they all failed? Also, please also try the MA2C codes in the google drive |
Thank you for your prompt reply, running run_maacktr.py and run_mappo.py files are the same result, how to register an ID? If the normal result is normal, will the video file be generated in the result? How should Google Drive be used, I haven't used it before, can you give me some pointers, thank you very much. |
Actually, running the codes in the correct manner may not lead to the error and you may see the videos after 200 episodes. You may try to run it under a different path. The link for the codes can be found at ReadMe.md. Please check the readme |
|
@DongChen06/MARL_CAVs ***@***.***>
[image: image.png]
hi , I'm getting this error, idk why,help me out
…On Thu, Nov 2, 2023 at 6:33 AM Dong Chen ***@***.***> wrote:
@ZhangTingyang <https://github.com/ZhangTingyang> Hi Tingyang, can you
run other algos? Or they all failed? Also, please also try the MA2C codes
in the google drive
Thank you for your prompt reply, running run_maacktr.py and run_mappo.py
files are the same result, how to register an ID? If the normal result is
normal, will the video file be generated in the result? How should Google
Drive be used, I haven't used it before, can you give me some pointers,
thank you very much.
Actually, running the codes in the correct manner may not lead to the
error and you may see the videos after 200 episodes. You may try to run it
under a different path. The link for the codes can be found at ReadMe.md.
Please check the readme
—
Reply to this email directly, view it on GitHub
<#2 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AR2ZYI5ZJWBXCN4SYGZ5DMTYCLWMRAVCNFSM47X6KHG2U5DIOJSWCZC7NNSXTN2JONZXKZKDN5WW2ZLOOQ5TCNZYHE4DSOJQHE4Q>
.
You are receiving this because you were mentioned.Message ID:
***@***.***>
|
|
@siddarth-mp Hi the figure was broken |
|
i guess merge_env is not been detected,along with some of these modules
…On Wed, Nov 8, 2023 at 5:42 PM Dong Chen ***@***.***> wrote:
@siddarth-mp <https://github.com/siddarth-mp> Hi the figure was broken
—
Reply to this email directly, view it on GitHub
<#2 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AR2ZYI6GWZZQVPDFNRHDS7TYDNZLVAVCNFSM47X6KHG2U5DIOJSWCZC7NNSXTN2JONZXKZKDN5WW2ZLOOQ5TCOBQGE3TMOJSGAYA>
.
You are receiving this because you were mentioned.Message ID:
***@***.***>
|
|
Also, just a friendly reminder, we do not need to install highway-env with pip, since we have all the necessary components in the package. |
|
ohk,so what's the issue
…On Wed, Nov 8, 2023 at 5:50 PM Dong Chen ***@***.***> wrote:
Also, just a friendly reminder, we do not need to install highway-env with
pip, since we have all the necessary components in the package.
—
Reply to this email directly, view it on GitHub
<#2 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AR2ZYI2QZX4G2Q6DMV4HWKLYDN2IJAVCNFSM47X6KHG2U5DIOJSWCZC7NNSXTN2JONZXKZKDN5WW2ZLOOQ5TCOBQGE3TQMBVGM3Q>
.
You are receiving this because you were mentioned.Message ID:
***@***.***>
|
|
Its fine, it worked, Thanks for ur time
…On Wed, Nov 8, 2023 at 5:53 PM Siddarth Mp ***@***.***> wrote:
ohk,so what's the issue
On Wed, Nov 8, 2023 at 5:50 PM Dong Chen ***@***.***> wrote:
> Also, just a friendly reminder, we do not need to install highway-env
> with pip, since we have all the necessary components in the package.
>
> —
> Reply to this email directly, view it on GitHub
> <#2 (comment)>,
> or unsubscribe
> <https://github.com/notifications/unsubscribe-auth/AR2ZYI2QZX4G2Q6DMV4HWKLYDN2IJAVCNFSM47X6KHG2U5DIOJSWCZC7NNSXTN2JONZXKZKDN5WW2ZLOOQ5TCOBQGE3TQMBVGM3Q>
> .
> You are receiving this because you were mentioned.Message ID:
> ***@***.***>
>
|
Great! What did you change to make it? |
|
as you mentioned in github replies, marked 'highway-env' as root source and
had to change interpreter to conda one instead of default python one
…On Wed, Nov 8, 2023 at 8:29 PM Dong Chen ***@***.***> wrote:
Its fine, it worked, Thanks for ur time
… <#m_-1737613044497525666_>
On Wed, Nov 8, 2023 at 5:53 PM Siddarth Mp *@*.*> wrote: ohk,so what's
the issue On Wed, Nov 8, 2023 at 5:50 PM Dong Chen @.*> wrote: > Also,
just a friendly reminder, we do not need to install highway-env > with pip,
since we have all the necessary components in the package. > > — > Reply to
this email directly, view it on GitHub > <#2 (comment)
<#2 (comment)>>,
> or unsubscribe >
https://github.com/notifications/unsubscribe-auth/AR2ZYI2QZX4G2Q6DMV4HWKLYDN2IJAVCNFSM47X6KHG2U5DIOJSWCZC7NNSXTN2JONZXKZKDN5WW2ZLOOQ5TCOBQGE3TQMBVGM3Q
> . > You are receiving this because you were mentioned.Message ID: > *@*.***>
>
Great! What did you change to make it?
—
Reply to this email directly, view it on GitHub
<#2 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AR2ZYI5LHWRWLKVAI3K75Z3YDOM5BAVCNFSM47X6KHG2U5DIOJSWCZC7NNSXTN2JONZXKZKDN5WW2ZLOOQ5TCOBQGIYDMMJTGI3Q>
.
You are receiving this because you were mentioned.Message ID:
***@***.***>
|
Hi! When I run the run_mappo.py，and something went wrong. But I have check the merge_env_v1, it's actually registered.
(marl_cav) h@qhan:~/rl/MARL_CAVs/MARL$ python run_mappo.py
Traceback (most recent call last):
File "/home/h/anaconda3/envs/marl_cav/lib/python3.6/site-packages/gym/envs/registration.py", line 121, in spec
return self.env_specs[id]
KeyError: 'merge-multi-agent-v0'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "run_mappo.py", line 225, in
train(args)
File "run_mappo.py", line 80, in train
env = gym.make('merge-multi-agent-v0')
File "/home/h/anaconda3/envs/marl_cav/lib/python3.6/site-packages/gym/envs/registration.py", line 145, in make
return registry.make(id, **kwargs)
File "/home/h/anaconda3/envs/marl_cav/lib/python3.6/site-packages/gym/envs/registration.py", line 89, in make
spec = self.spec(path)
File "/home/h/anaconda3/envs/marl_cav/lib/python3.6/site-packages/gym/envs/registration.py", line 131, in spec
raise error.UnregisteredEnv('No registered env with id: {}'.format(id))
gym.error.UnregisteredEnv: No registered env with id: merge-multi-agent-v0
The text was updated successfully, but these errors were encountered: