Deprecate track_stats=true
for GroupNorm
and InstanceNorm
#2006
Labels
Milestone
track_stats=true
for GroupNorm
and InstanceNorm
#2006
We discussed this on Slack, and it appears other libraries do not track running stats for either. Nor do any papers appear to make use of a running average. Thus the complexity feels very much not worth it, and doing it by default creates unnecessary inconsistencies with the rest of the ecosystem.
The rough deprecation plan for this is as follows:
track_stats=true
, with a pointer to usetrack_stats=false
since the former will go away in the next breaking Flux release. This is the "good first issue" part.track_stats
as a vestigial kwarg. Alternatively, we could remove it completely.The text was updated successfully, but these errors were encountered: