Is there any quantitative analysis of the experimental results of MSA and EMSA?

[superPangpang]

I think it is a necessary ablation study to make a quantitative comparison of performance and efficiency of the two modules. But it's not in the paper

[wofmanaf]

I agree with you, the results of the quantitative comparison between MSA and EMSA will be available soon.

[wofmanaf]

Follow the same setting as the ablation study. Batch size for MSA is 512 (one V100 GPU can only tackle 64 images at the same time), for EMSA is 2048. Results of ResT-Lite:

Backbones	#Param (M)	FLOPs (G)	Throughput	Top-1	Top-5
MSA	10.48	1.6	512	72.68	90.46
EMSA	10.49	1.4	1246	72.88	90.62

[wofmanaf]

The quantitative comparison between MSA and EMSA has been released in the version v3