You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Original post:
Some variables, such as learning rate, are scalar, i.e. their shape doesn't depend on batch size. These variables can't be stated in the model outputs.
AddScalar hook should overcome this problem and add specific scalars to epoch_data['train'][variable_name]
Such hook will be used in the beginning of the hook list.
Adam
This is actually back-end specific. We would need to enforce model API similar to this:
Migrated from https://github.com/Cognexa/cxflow/issues/186
Original post:
Some variables, such as learning rate, are scalar, i.e. their shape doesn't depend on batch size. These variables can't be stated in the model outputs.
AddScalar hook should overcome this problem and add specific scalars to
epoch_data['train'][variable_name]
Such hook will be used in the beginning of the hook list.
Adam
This is actually back-end specific. We would need to enforce model API similar to this:
Which is actually quite interesting. We would be able to write more back-end agnostic hooks such as DecayLR etc.
The text was updated successfully, but these errors were encountered: