can you provide transfer learning code?

[ai-motive]

Hi~ @Green-Wood

I wanna apply trasnfer learning using pretrained model.

but, LightningCLI() is wrapped and difficult to customize.

Thanks & best regards.

[Green-Wood]

If you want to finetune our model in the other dataset, I suggest you refer to PyTorch-Lightning transfer learning documentation and PyTorch official tutorial.

Basically, you need to:

1. load pretrained model.
2. freeze some layers.
3. train it on the other dataset.

Like the following code:

from bttr.datamodule import CROHMEDatamodule
from bttr import LitBTTR
from pytorch_lightning import Trainer

# model
model = LitBTTR.load_from_checkpoint(ckp_path)

# data
dm = SomeOtherDataset()

# train
trainer = Trainer()
trainer.fit(model, datamodule=dm)

# test using the best model!
trainer.test(datamodule=dm)

However, we won't give out these codes in this repo directly.
Hope that can help you.