Some questions about Paper

[duzhenjiang113]

Hi, Xumin. It's a great paper and I'm inspired a lot. I have a question about the ablation experiment in the paper. When using the baseline test, the result generated by the query generator is replaced, how do the Dynamic Queries of the Transformer decoder be generated? Thanks a lot.

[yuxumin]

We replace the query generator with learnable parameters in the ablation study, which is similar to the practice in DETR.

[duzhenjiang113]

We replace the query generator with learnable parameters in the ablation study, which is similar to the practice in DETR.

Thanks for your reply. So, it seems it's a linear projection without max pooling operation. Is my understanding correct or not?

[yuxumin]

Not really, the queries are independent of the outputs of the encoder. In that case, outputs of the encoder are only used as the memory of the decoder (cross attention) and produce the coarse center points, while the queries of the decoder are some pre-defined and learnable parameters. You can get more details from DETR pipeline (End-to-End Object Detection with Transformers) .

[duzhenjiang113]

Not really, the queries are independent of the outputs of the encoder. In that case, outputs of the encoder are only used as the memory of the decoder (cross attention) and produce the coarse center points, while the queries of the decoder are some pre-defined and learnable parameters. You can get more details from DETR pipeline (End-to-End Object Detection with Transformers) .

Thanks, I'll check it.