Intermediate results of training R2B model

[Hyungjun-K1m]

Hi,

It is so nice that you almost reproduced the r2b model (65.04% top-1 accuracy).
Can you also provide the intermediate results of training process of r2b model?
For instance, the top-1 accuracy of each stage might be very helpful for me.

Thanks!

[leonoverweel]

Hi, thanks for checking out Larq Zoo. @timdebruin and I went back through some old experiments to find their top-1 accuracies for you; here's the details:

Stage	Description	Epochs	Train acc	Val acc
1 - ResNet	FP weights, FP activations	100	70.87%	70.32%
2 - R2B_FP	FP weights, FP activations	75	69.53%	71.21%
3 - R2B_BAN	FP weights, binary activations	75	63.70%	67.12%
4 - R2B_BNN	Binary weights, binary activations	100	62.57%	65.04%

Hope this helps!

[Hyungjun-K1m]

Great! I really appreciate your fast response! Do you also have the results for strong baseline?

[leonoverweel]

No problem. Sadly I couldn't find our experiment data for the strong baseline, but from my notes at the time I think we got 62% validation accuracy.

[Hyungjun-K1m]

Cool! 62% is even higher than what is reported on the paper! Do you have any thoughts on what caused this improvement?

[appleleaves]

I can only reach about 65% training

ResNet | FP weights, FP activations | 100

I used 8 cards and simply ran the code.

Would you like to share some models or advice?
@leonoverweel