GCNet vs. Non-Local module

[Senwang98]

@yzd-v
Hi, thanks for your simple and powerfull KD method. I have one question, why use GCNet rather commonly used Non-local module,
Have you test these two OPs since GCNet is little better than Non-local.(Maybe some experiments about these two modules can be added into your paper, since this is one question reviewers intuitively will ask)

[yzd-v]

Both GCNet and non-local can be used to add global knowledge for distillation. And we compare them in ablation study. The lighter GCNet is easier to train for distillation.

[Senwang98]

@yzd-v
Okay, I have seen Table 6. in your paper.

[yzd-v]

You may read the two papers carefully. In table 6, we just use global distillation without focal distillation. While the result in FKD is achieved with all losses. However, Faster RCNN can achieve 42.0 mAP with focal and global distillation together.

[Senwang98]

@yzd-v
Ok, it's my fault(feel a bit embarrassed, I will delete above pictures......23333)