Variation-Aware Trigger?

[hkchengrex]

Hi, thank you for the code & paper.
I am looking through the code and cannot seem to find the implementation of the VAT. It appears to me that the memory scheduling is fixed:

SwiftNet/eval.py

Line 42 in 02c7f44

to_memorize = [int(i) for i in np.arange(0, num_frames, step=Mem_every)]

Am I missing something?
Also, does y_t in the paper refer to the binarized "hard" mask or soft mask?
Thanks!