Continual Tranformers
Added
- Citations for Continual Inference lib paper.
- Docs.
- Automatic conversion for RNN modules.
- Continual Transformer modules, including:
RecyclingPositionalEncoding
RetroactiveMultiheadAttention
SingleOutputMultiheadAttention
SingleOutputTransformerEncoderLayer
RetroactiveTransformerEncoderLayer
TransformerEncoderLayerFactory
TransformerEncoder