Skip to content

Continual Tranformers

Choose a tag to compare

View all tags
@LukasHedegaard LukasHedegaard released this 12 May 15:40
· 192 commits to main since this release
v0.17.0
16e35ba
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.

Added

  • Citations for Continual Inference lib paper.
  • Docs.
  • Automatic conversion for RNN modules.
  • Continual Transformer modules, including:
    • RecyclingPositionalEncoding
    • RetroactiveMultiheadAttention
    • SingleOutputMultiheadAttention
    • SingleOutputTransformerEncoderLayer
    • RetroactiveTransformerEncoderLayer
    • TransformerEncoderLayerFactory
    • TransformerEncoder
Assets 2
Loading