ourddpg performance not good

[ChenDRAG]

I run the source code of TD3: ourddpg algorithm and find performance in most games(apart from HalfCheetah-v3_0) is inconsistent with the original paper? Could you illustrate what might be the problem, please?

[sfujim]

I'll take a look at this, but noting that the versions have changed (python, pytorch, and mujoco), I'm not sure much can be said about a direct comparison with the original results any more.

[ChenDRAG]

Maybe it's because of hyperparameters? Could you specify the parameters used for ourddpg? Are those same as used in td3?

[johnnylin110]

I also want to ask the hyperparameters of ourddpg , and I follow the network and your hyperparameters in paper

and reproduce it in tensorflow version , which also got the bad result , is there any other hyperparameters different?
Like "Replay buffer size", and "start_timesteps" what hyperparameters are them when using our ddpg? are they the same as mention in paper? (start timesteps in Ant and Halfcheetah is 10000 and the other is 1000)

[sfujim]

Sorry for the delays! I've updated the hyperparameters to OurDDPG which should improve the performance. But in general if you want a good performance there's little reason not to use TD3, OurDDPG is just a baseline.