Skip to content

xyutao/bocl

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

14 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Bi-objective Continual Learning: Learning 'New' while Consolidating 'Known'

Comparison Results

The detailed test accuracies of each method under different datasets are listed in the following table. The reported results are avearaged over 5 runs with different settings of patterns.

CIFAR10 with the full set of training samples

Method/Sessions 1 2 3 4 5
Naive 67.80 69.31 71.37 73.12 73.23
Cumulative 67.80 76.13 81.22 81.73 82.12
EWC* 67.80 69.45 72.68 74.02 74.31
SI* 67.80 70.48 72.82 74.63 74.58
IMM* 67.80 69.69 72.85 74.37 73.84
EEIL* 67.80 71.97 73.27 74.91 74.66
A-GEM* 67.80 72.27 73.72 74.81 75.15
Our-PLC 67.80 72.75 75.16 76.01 76.98
Our-PLC-CPL 67.80 73.60 76.01 76.65 77.43

CIFAR10 with the randomly sampled set of training samples

Method/Sessions 1 2 3 4 5
Naive 67.80 67.61 67.86 68.40 68.19
Cumulative 67.80 71.82 72.30 72.60 72.72
EWC* 67.80 68.27 69.32 68.99 69.27
SI* 67.80 68.56 69.53 69.27 70.24
IMM* 67.80 68.07 69.65 69.95 70.38
EEIL* 67.80 69.83 69.01 70.01 69.96
A-GEM* 67.80 70.28 70.71 69.97 70.97
Our-PLC 67.80 70.10 70.79 70.69 71.27
Our-PLC-CPL 67.80 71.50 71.90 71.70 72.10

CIFAR100 with the full set of training samples

Method/Sessions 1 2 3 4 5
Naive 39.73 44.00 46.28 47.59 49.16
Cumulative 39.73 47.60 51.10 55.19 59.03
EWC* 39.73 44.52 46.88 48.17 49.83
SI* 39.73 44.61 46.95 48.68 50.92
IMM* 39.73 44.87 47.03 49.38 50.98
EEIL* 39.73 45.03 47.65 50.22 51.12
A-GEM* 39.73 45.13 47.89 50.21 51.24
Our-PLC 39.73 46.46 49.11 51.12 52.90
Our-PLC-CPL 39.73 47.15 49.78 51.64 53.76

CIFAR100 wih the randomly sampled set of training samples

Method/Sessions 1 2 3 4 5
Naive 39.73 37.43 37.03 37.29 36.77
Cumulative 39.73 42.32 43.83 45.34 46.75
EWC* 39.73 37.87 37.85 38.26 38.28
SI* 39.73 38.76 39.07 39.48 39.81
IMM* 39.73 39.74 39.89 40.21 40.25
EEIL* 39.73 39.73 39.09 39.62 40.01
A-GEM* 39.73 40.01 40.19 40.68 40.89
Our-PLC 39.73 40.95 41.00 41.12 41.55
Our-PLC-CPL 39.73 40.94 41.07 41.21 41.87

CORe50 with the full set of training samples

Method/Sessions 1 2 3 4 5 6 7 8
Naive 51.00 64.50 60.10 62.41 59.97 63.26 65.09 67.61
Cumulative 51.00 65.10 72.30 74.80 77.20 77.80 78.50 79.20
EWC* 51.00 63.98 61.02 62.72 59.84 63.66 65.12 66.89
SI* 51.00 64.01 62.15 61.56 59.48 63.88 64.85 67.21
IMM* 51.00 64.51 62.51 63.21 60.12 63.32 66.12 68.54
EEIL* 51.00 63.74 64.88 62.56 60.56 64.45 67.00 70.00
A-GEM* 51.00 64.72 65.17 63.54 61.54 66.48 67.21 71.54
Our-PLC 51.00 63.46 65.76 64.49 64.04 68.65 70.20 73.15
Our-PLC-CPL 51.00 63.52 66.86 64.92 64.58 69.67 71.14 74.31

CORe50 with the randomly sampled set of training samples

Method/Sessions 1 2 3 4 5 6 7 8
Naive 51.00 57.00 50.69 55.26 49.81 59.94 60.52 63.00
Cumulative 51.00 60.76 67.14 70.41 72.59 74.20 74.90 76.10
EWC* 51.00 57.73 52.99 56.34 52.41 60.40 61.84 64.53
SI* 51.00 57.81 53.06 56.46 52.64 60.53 61.91 64.73
IMM* 51.00 57.96 53.58 56.61 53.23 60.61 62.04 64.95
EEIL* 51.00 57.12 55.95 56.72 55.21 60.84 62.67 65.12
A-GEM* 51.00 58.03 56.16 57.65 55.52 60.76 63.11 65.24
Our-PLC 51.00 59.80 58.35 58.75 58.91 61.15 65.19 66.98
Our-PLC-CPL 51.00 60.11 58.77 59.05 59.03 62.68 65.39 67.83

SubImageNet with the full set of training samples

Method/Sessions 1 2 3 4 5
Naive 22.06 28.49 34.21 40.48 45.46
Cumulative 22.06 31.36 42.29 52.98 58.27
EWC* 22.06 28.32 34.28 38.26 40.73
SI* 22.06 28.61 34.57 40.14 47.86
IMM* 22.06 29.28 35.64 42.64 48.52
EEIL* 22.06 28.45 34.08 41.05 47.84
A-GEM* 22.06 29.39 35.84 42.38 47.17
Our-PLC 22.06 29.59 36.38 43.19 49.16
Our-PLC-CPL 22.06 30.15 37.32 44.51 50.32

SubImageNet with the randomly sampled set of training samples

Method/Sessions 1 2 3 4 5
Naive 22.06 25.97 28.11 29.57 31.64
Cumulative 22.06 29.60 34.63 37.44 39.51
EWC* 22.06 25.07 28.15 30.38 33.49
SI* 22.06 25.45 28.61 30.51 33.85
IMM* 22.06 26.24 28.34 31.76 33.34
EEIL* 22.06 25.05 28.71 31.03 34.21
A-GEM* 22.06 26.71 28.53 31.97 34.53
Our-PLC 22.06 26.33 29.16 33.39 36.43
Our-PLC-CPL 22.06 27.42 30.67 34.11 37.77

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published