Code to build the spatial adjacency matrix

[yashkant]

Hi,

Thanks for sharing the code. Could you also share the code for building the adjacency matrix of spatial relations from bounding boxes?

Thanks.

[linjieli222]

Thank you for your interests in this project. You can call this function to build spatial graph:

VQA_ReGAT/model/position_emb.py

Line 41 in 9f6fe5b

def build_graph(bbox, spatial, label_num=11):

[yashkant]

Thanks for the instant reply @linjieli222, could you help me with these follow-up questions:

1. What is the spatial argument which is used below? Also, is bbox[0] the image bounding-box?
   

   VQA_ReGAT/model/position_emb.py

   Line 57 in 9f6fe5b

   image_h = bbox_height[0]/spatial[0, -1]

2. Are the bbox coordinates normalized or are they absolute values?

[linjieli222]

Sorry about the confusion.

1. spatial here is just normalized bb. It is only used to get image_h and image_w. If you happen to have image_h and image_w in hand, no need to generate normalized bb
2. bbox is not normalized, just pass it as it is from detection model.