About referring expression grounding

[pengzhiliang]

Thanks for the great work!

When I try the grounding demo file, I find a sentence (eg. a man in blue coat) will be splited into multiple phrases (eg. a man, blue coat) and the model will predict multiple boxes correspondding to the phrase. In fact, the model is expected to generate just one box (a man), just like the Referring Expression Grounding task. It seems this model can't handle this task. Or do I need to adjust some hyper-parameters?

But If this model cuts the given sentence into multiple phrases, how it is tested on RefCOCO dataset and achieves impressive performance.

I'm little confused about it.

Thanks!

[SlongLiu]

We select the box with the highest text similarities as top-1 outputs. The model inputs and outputs can be found here: https://github.com/IDEA-Research/GroundingDINO#star-explanationtips-for-grounding-dino-inputs-and-outputs . I add a paragraph to explain the model.

[drilistbox]

Thanks for your great work, but I am confusing about how to detect "the left dog".