how to do tracking with just 1 frame detection [detect and track]

[akshay-sn]

Hi,

I have a vehicle detection algorithm that provides a bounding box for only 1 frame for 30 frames/. i.e. every 30 frames I get a new bounding box.

In this context, for the remaining 29 frames I would like to apply SORT to track. I am able to run the demo script. however, when I try to track for more frames, it does not. Could you provide some info as to how to adapt SORT for detecting and tracking?

[abewley]

To use SORT out-of-the-box in a realtime application you will need a realtime detector. Maybe something like SqueezeDet.

SORT only has a simple prediction component based on a linear Kalman filter. You will need to change this to suit your problem. I would suggest using some optical flow based or a per instance based tracker that uses both appearance and inter-frame motion like HART.

If you don't need realtime and can wait for you next detection you could use SORT on every 30th frame. If the displacement is large (due to low framerate), then consider DeepSORT which used appearance features for better association, but (for now) daily only works on pedestrians.

Closing as this is not an issue.