How to do Fine tuning with Custom dataset?

[SagarPalyal]

Hi Team,

I have a Custom domain specific dataset having Text paragraphs as an input and summary text as an target variable. Can anyone help me what the steps now I need to follow for fine-tuning existing pegasus model with my custom data. Currently I am using Pegasus_wiki model for summary generation.
As I am new to this , I am not able to understand fine tuning section with custom dataset.
Can anyone help me now with following:

1. How to convert my mentioned dataset into tfds or tfRecords format.
2. Once converted into tfds/tfRecords format, how to use this to fine-tune existing model.
   Also, if I am missing something , please enlighten me.

Thanks in advance.

[JingqingZ]

Hi hope these may help

#13 (comment)

#21 (comment)