how does DNI updating works really? a quick question

[martianmartian]

Say there's a 4 layer network, using DNI, does the first layer get updated 4 times during each forward-backward cycle? i couldn't find out from the paper..

[andrewliao11]

just once. there's no reason to update the first layer multiple times for each batch

[andrewliao11]

I'll first close this issue.
feel free to reopen it if there are other questions