Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

混合动作空间环境，PPO使用gae_estimator报错 #784

Closed
dajianer opened this issue Mar 26, 2024 · 3 comments
Closed

混合动作空间环境，PPO使用gae_estimator报错 #784

dajianer opened this issue Mar 26, 2024 · 3 comments
Labels
bug Something isn't working

Comments

@dajianer
Copy link

我的环境是混合动作空间的，在仿照例子运行PPO时，gae_estimator报错：RuntimeError: Could not infer dtype of EasyDict
image
查看源码发现这个函数不支持混合动作空间，请问应该怎么解决呢
@PaParaZz1 PaParaZz1 added the bug Something isn't working label Mar 27, 2024
@zjowowen
Copy link
Collaborator

zjowowen commented Mar 28, 2024 •
edited

谢谢你发现了这个问题。这个 Bug 是因为组件的修改导致的不兼容。你可以根据这个 Pull Request 中的修改方法来更新这部分的代码，并重新运行这个例子。
#786

@PaParaZz1 PaParaZz1 mentioned this issue Apr 2, 2024
Merged
@zjowowen
Copy link
Collaborator

zjowowen commented Apr 2, 2024 •
edited

混合动作空间的配置文件可以参考：
https://github.com/zjowowen/DI-engine/blob/main/dizoo/gym_hybrid/config/gym_hybrid_hppo_config.py

@PaParaZz1
Copy link
Member

我们已经在 #786 中修复了这个问题

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@PaParaZz1 @dajianer @zjowowen