Smart shot splitting

[cvondrick]

Is it possible segment the video based on the scene of the video. For example, if the background of one video does not change, your code currently still split the videos into segments with each having about 330 frame, but it would be better to just segment it into one piece, so you don't have to initialize all the objects again and again for all the segments.

This is entirely possible and I think a worthwhile addition. We should be smarter in how we split up videos. I think there is some neat future work in this domain that would be impactful: you could imagine trying to split up each shot so that we each segment is the same amount of work. (We still need to split up shots for constant background, though, for MTurk).