How to give mmgrounding dino few-shot image examples like owl-vit?

[zappy586]

Mmgrounding seems really promising for few-shot object detection. But the early modality fusion makes the architecture very confusing. Has anyone tried to convert this model into a few-shot learner or has any ideas on how to do it?