Author's code used in the paper The Role of Target Update Frequencies in Q-Learning published at ICML 2026.
The experiments for ICDQN are run with the RL Baselines3 Zoo Training framework and are based on the Stable Baselines3 framework. For the experiments on BTR+RISE, a variant of BTR, the authors thank Tyler Clark for sharing his code, which was used as a framework.