The setup of Piggyback in Table 6

[joemzhao]

Dear authors,

Thanks for sharing the code!

I didn't quite get the setup of Piggyback in Table 6 in your paper.
I guess PackNet is the application of Piggyback in continual learning. Then what is the difference between Piggyback and PackNet in Table 6, when being sequentially applied to the 6 image classification tasks?

Thanks!

[CEWu]

@joemzhao
The difference between Packnet and Piggyback is that Piggyback uses the learnable binary mask (piggymask) to pick the weights from the base task (e.g. ImageNet) to learn the sequential new tasks, but Packnet does not; Packnet learns the new task by filling the remaining weights from previous tasks (via weight pruning).

[joemzhao]

oh I see, thanks for the clarification!