Entropy-based Stability-Plasticity for Lifelong Learning

This repository contains the implementation of ESP.

Requirements

• torch 1.10.0
• transformers 3.0.2

Natural Language Experiment

Run the following command to train the model:

$ bash run_nlp.sh

To get it to work, it is mandatory to update the DATA_DIR and OUTPUT_DIR directories of the run_nlp.sh file. Also, it is possible to choose the execution order by setting the ORDER variable. On the other hand, you can modify some parameters for ESP training.

• mem_capacity: replay set size from 0 to 1
• only_mem: activate to use ONLY setup (See Section 4.1 of the paper)
• dynamic_freeze: allow freezing layers on-the-fly

Computer Vision Experiment

Run the following command to train the model:

$ bash run_cv.sh

One can modify some parameters for ESP training.

• use_highway: activate to use the branch classifiers to the model
• pretrained: activate to use a pre-trained ResNet-18
• train_highway_only: activate to use a ONLY the memory to train the branch classifiers
• mem_per_tasks: amount of element per task to save in memory
• only_mem: activate to use ONLY the memory to train the model