d3rlpy.models
d3rlpy provides OptimizerFactory
that gives you flexible control over optimizers. OptimizerFactory
takes PyTorch's optimizer class and its arguments to initialize, which you can check more here.
import d3rlpy
from torch.optim import Adam
# modify weight decay
optim_factory = d3rlpy.models.OptimizerFactory(Adam, weight_decay=1e-4)
# set OptimizerFactory
dqn = d3rlpy.algos.DQNConfig(optim_factory=optim_factory).create()
There are also convenient alises.
# alias for Adam optimizer
optim_factory = d3rlpy.models.AdamFactory(weight_decay=1e-4)
dqn = d3rlpy.algos.DQNConfig(optim_factory=optim_factory).create()
d3rlpy.models.OptimizerFactory d3rlpy.models.SGDFactory d3rlpy.models.AdamFactory d3rlpy.models.RMSpropFactory