You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Did you ever try to combine the ZEN-Score with the NTK-score like the TE-NAS paper did? The TE-NAS paper suggests that combining the NTK-Score with a expressivity measure would improve the overall performance.
Thanks,
SXK
The text was updated successfully, but these errors were encountered:
Good idea! We did not try Zen + NTK. It might worth a try. Please be aware that the NTK also suffers from the BN normalization problem, so you should calibrate the gradient norm too.
Hello MingLin,
I found your NAS approach to be very interesting.
Did you ever try to combine the ZEN-Score with the NTK-score like the TE-NAS paper did? The TE-NAS paper suggests that combining the NTK-Score with a expressivity measure would improve the overall performance.
Thanks,
SXK
The text was updated successfully, but these errors were encountered: