Awesome Continual Self-Supervised Learning

List of papers that combine self-supervision and continual learning

Papers

2023

• Sy-CON: Symmetric Contrastive Loss for Continual Self-Supervised Representation Learning (arXiv 2023) [paper]
• CoRaL: Continual Representation Learning for Overcoming Catastrophic Forgetting (AAMAS 2023) [paper]
• Kaizen: Practical self-supervised continual learning with continual fine-tuning (arXiv 2023) [paper][code]
• CSSL-MHTR: Continual Self-Supervised Learning for Scalable Multi-script Handwritten Text Recognition (arXiv 2023) [paper]
• Efficient Self-supervised Continual Learning with Progressive Task-correlated Layer Freezing (arXiv 2023) [paper]
• Towards Label-Efficient Incremental Learning: A Survey (arXiv 2023) [paper]
• Are Labels Needed for Incremental Instance Learning? (CVPRW 2023) [paper]
• Continual Barlow Twins: continual self-supervised learning for remote sensing semantic segmentation (arXiv 2023) [paper]
• SCALE: Online Self-Supervised Lifelong Learning without Prior Knowledge (CVPRW 2023) [paper]

2022

• Grow and Merge: A Unified Framework for Continuous Categories Discovery (NeurIPS 2022) [paper]
• Beyond Supervised Continual Learning: a Review (ESANN 2022) [paper]
• How Well Does Self-Supervised Pre-Training Perform with Streaming Data? (ICLR 2022) [paper]
• Continual Contrastive Learning for Image Classification (ICME 2022) [paper]
• Task Agnostic Representation Consolidation: a Self-supervised based Continual Learning Approach (CoLLAs 2022) [paper] [code]
• Continually Learning Self-Supervised Representations with Projected Functional Regularization (CVPR 2022) [paper]
• Representational Continuity for Unsupervised Continual Learning (ICLR 2022) [paper] [code]
• Self-Supervised Models are Continual Learners (CVPR 2022) [paper] [code]
• The Challenges of Continuous Self-Supervised Learning (ECCV 2022) [paper] [code]
• MUSCLE: Multi-task Self-supervised Continual Learning to Pre-train Deep Models for X-Ray Images of Multiple Body Parts (MICCAI 2022) [paper]

2021

• Self-Supervised Class Incremental Learning (arXiv 2021) [paper]
• DualNet: Continual Learning, Fast and Slow (NeurIPS 2021) [paper] [code]
• Co²L: Contrastive Continual Learning (ICCV 2021) [paper] [code]
• SPeCiaL: Self-Supervised Pretraining for Continual Learning (IJCAI-W 2021) [paper]
• Prototype Augmentation and Self-Supervision for Incremental Learning (CVPR 2021) [paper]
• Self-Supervised Training Enhances Online Continual Learning (BMVC 2021) [paper]
• Reduce the Difficulty of Incremental Learning With Self-Supervised Learning (2021) [paper]

2020

• Self-Supervised Learning Aided Class-Incremental Lifelong Learning (arXiv 2020) [paper]

2019

• Continual Unsupervised Representation Learning (NeurIPS 2019) [paper]