about the gate shift module

[luchen828]

HI!
How does GSM selectively integrate spatial and temporal information through gating？
When the gating values are different, which py file in the project can be found the differencing and averaging operation for the temporal feature ?
hope for your reply,thanks!

[swathikirans]

Hi, temporal information is injected by shifting and the gating select how much of the features are to be shifted. The code do not have the edge cases of gating, i.e., averaging and differencing. You can achieve this by editing lines 34 and 35 in the gsm.py file. (-1 for differencing and +1 for averaging).

[luchen828]

Thank you very much for your reply!
What do average and difference mean? Or what does that mean for data processing? If you are busy, you can tell me how to check the relevant knowledge.
Your help is greatly appreciated

[luchen828]

The features selected by the gating module are sent to the time-shifting module. So, what features need to be sent to the time-shifting module? In other words, what are the criteria for selecting features of the gating module?

[swathikirans]

Hi, there is no predefined rule for feature selection. The module learns from the input data. In short, the routing of features is data dependent and not hardwired.