This seems like it would be a great option for increasing context window in sequences. Have you tried that yet? #9
Description
Just suggesting you try a similar architecture with sequences rather than images.
{{ message }}
Just suggesting you try a similar architecture with sequences rather than images.