About the annotations

[yeliudev]

Hi @jayleicn, thanks for your great work! I notice that in the annotation files, as shown below, the duration of a video (126s) does not match the actual duration (810s - 660s = 150s). May I ask that should I crop the original video to 126s before processing in this case?

{
    "qid": 8737, 
    "query": "A family is playing basketball together on a green court outside.", 
    "duration": 126, 
    "vid": "bP5KfdFJzC4_660.0_810.0", 
    "relevant_windows": [[0, 16]],
    "relevant_clip_ids": [0, 1, 2, 3, 4, 5, 6, 7], 
    "saliency_scores": [[4, 1, 1], [4, 1, 1], [4, 2, 1], [4, 3, 2], [4, 3, 2], [4, 3, 3], [4, 3, 3], [4, 3, 2]]
}

[jayleicn]

Hi @yeliudev, do you have a stat on how often this happens?

[yeliudev]

Hi @yeliudev, do you have a stat on how often this happens?

213 out of 7218, 39 out of 1550, and 47 out of 1542 annotations are mismatched in train, val, and test splits respectively. All the duration computed from the vids are 150s.

[jayleicn]

Thanks! The real processed video length is stated by duration, the timestamps in vid are what I used to segment the original long videos. So you crop them if longer than duration.

[yeliudev]

I see. Thanks for your help!