Skip to content

v0.4.0

Choose a tag to compare

View all tags
@PaParaZz1 PaParaZz1 released this 21 Jun 12:37
· 404 commits to main since this release
v0.4.0
47940ef

API Change

  1. refactor DI-engine doc and update doc links doc | 中文文档
  2. refactor default logging lib and add DI-toolkit (ditk) requirement (just enter pip install DI-toolkit)

Env (dizoo)

  1. add MAPPO/MASAC all configs in SMAC (#310) (SOTA results in SMAC!!!)
  2. add dmc2gym env (#344) (#360)
  3. remove DI-star requirements of dizoo/smac, use official pysc2 (#302)
  4. add latest GAIL mujoco config (#298)
  5. polish procgen env (#311)
  6. add MBPO ant and humanoid config for mbpo (#314)
  7. fix slime volley env obs space bug when agent_vs_agent
  8. fix smac env obs space bug
  9. fix import path error in lunarlander (#362)

Algorithm

  1. add Decision Transformer algorithm (#327) (#364)
  2. add on-policy PPG algorithm (#312)
  3. add DDPPO & add model-based SAC with lambda-return algorithm (#332)
  4. add infoNCE loss and ST-DIM algorithm (#326)
  5. add FQF distributional RL algorithm (#274)
  6. add continuous BC algorithm (#318）
  7. add pure policy gradient PPO algorithm (#382)
  8. add SQIL + SAC algorithm (#348)
  9. polish NGU and related modules (#283) (#343) (#353)
  10. add marl distributional td loss (#331)

Enhancement

  1. add new worker middleware (#236) (new DRL programming model and pipeline example)
  2. refactor model-based RL pipeline (ding/world_model) (#332)
  3. refactor logging system in the whole DI-engine (#316)
  4. add env supervisor design (#330)
  5. support async reset for envpool env manager (#250)
  6. add log videos to tensorboard (#320)
  7. refactor impala cnn encoder interface (#378)

Fix

  1. env save replay bug
  2. transformer mask inplace operation bug
  3. transtion_with_policy_data bug in SAC and PPG

Style

  1. add dockerfile for ding:hpc image (#337)
  2. fix mpire 2.3.5 which handles default processes more elegantly (#306)
  3. use FORMAT_DIR instead of ./ding (#309）
  4. update quickstart colab link (#347)
  5. polish comments in ding/model/common (#315)
  6. update mujoco docker download path (#386)
  7. fix protobuf new version compatibility bug
  8. fix torch1.8.0 torch.div compatibility bug
  9. update doc links in readme
  10. add outline in readme and update wechat image
  11. update head image and refactor docker dir

Contributors: @PaParaZz1 @sailxjx @puyuan1996 @ZHZisZZ @Will-Nie @zjowowen @HansBug @zerlinwang @Weiyuhong-1998 @davide97l @hiha3456 @LuciusMos @kxzxvbk @lixl-st @zhangpaipai @song2181 @karroyan

Contributors

sailxjx, HansBug, and 15 other contributors
Assets 2
Loading