random reset issues (video proof added)

[hanbrianlee]

Hi, I've ran your VAD on my local machine, and I found out that randomly (sometimes every 5 or 10 seconds, it varies), the whole scene resets (as if the scene just started) even though the scene is staying the same.

This issue is not apparent on your github youtube video, but when collected via local machine run, it has this issue.

Is this related to some library version issue or is there some bug currently in the latest code?
If you run them on your environment right now, with the latest code on your repo, does it not have this random reset issue?

[hanbrianlee]

Added a 5seconds video clip of what I'm talking about:
https://youtube.com/clip/UgkxxrGSGYpTkVlO_wB5D2ZejpBf2bRSCyIM?si=eKG97sFiWg-Yus11

Full video of the local run is available here:
https://youtu.be/JCJ-nLEADts?si=PeNDDOXgzTHehAtZ

[ktnguyen17]

I think they are actually not the same scene but consecutive scenes that are recorded at the same place. The video provided in this repo just happens to pick scenes that are not consecutive.

[hanbrianlee]

Hi. Not sure I follow. Did you mean to say the video provided by authors in this repo happened to pick scenes that “are” consecutive?
The video i collected running locally is based on the same test data as the video on the repo. So I am not sure why there’s a difference.. unless the data for the same scene (one set of consecutive scene but split up so that each scene is limited by x amount of seconds) was somehow patched together for author’s video that they did not share that patching code.

[hanbrianlee]

For anyone wondering, as @ktnguyen17 pointed out, the video doesn't have these reset issues because the video on github avoids picking scenarios where there are more than 1 consecutive scenes.
To clarify, if an intersection consists of say 40 seconds, then if each scene token gets say 10secs, then technically this one intersection can contain 4 different (consecutive) scenes. And inbetween scenes, the model does reset, even though the data for that intersection technically could be consecutively connected.