Skip to content

Training KPIS

Marco Marini edited this page May 16, 2024 · 9 revisions

TDAgent

The TDAgent generates the following kpis at each step

Key Values
s0.* the network signals
actions.* the actions
reward the reward

At each training mini-batch step

Key Values
delta the delta value (error)
avgReward the average reward
trainingLayers.* the training layer values
trainedLayers.* the trained layer values
actionMasks.* the action masks
grads.* the output gradients
deltaGrads.* the output gradients multiply by delta

Batch trainer

The batch trainer generates the following kpis at each training mini-batch step

Key Values
delta the delta value (error)
avgReward the average reward
trainingLayers.* the training layer values
trainedLayers.* the trained layer values
actionMasks.* the action masks
grads.* the output gradients
deltaGrads.* the output gradients multiply by delta

Release 0.17.0

Clone this wiki locally