Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Zero win rate in SMAC scenario #6

Open
George-Chia opened this issue Jul 9, 2022 · 2 comments
Open

Zero win rate in SMAC scenario #6

George-Chia opened this issue Jul 9, 2022 · 2 comments

Comments

@George-Chia
Copy link

Hello, thanks for your elegant code.
When I directly run:
python dicg_ce_smac_runner.py --map 3s_vs_5z
python dicg_ce_smac_runner.py --map 6h_vs_8z
the win rate is always zero.

When I directly run:
python dicg_ce_smac_runner.py --map 8m_vs_9m
the win rate is lower than 0.1,
which are very different from the results reported in the paper.

Can you give me a hand?

@parachutel
Copy link
Member

How many environment steps did your experiments take?

@George-Chia
Copy link
Author

More than 800 steps shown in the tensorboard, where I find the EvalAvgReturn is converge to 10.8.
By the way, dicg_de_smac_runner.py --map 8m_vs_9m can achieve 0.9 win rate in the same environment step.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants