load and finetune

[ZiyeLuo]

Hi, I am finding it difficult to use fairseq framework. Do you know how to import models directly with pytorch and fine-tune them?

[renqianluo]

@ZiyeLuo We will try to convert it.

[kamalkraj]

Hi,
I am working on a PR to implement BioGPT with huggingface transformers - huggingface/transformers#20420

progress so far

Install transformers from this PR for experiments.

[renqianluo]

@kamalkraj That is very cool!

[parthplc]

Hey @kamalkraj, I used the Text Generation model but not the question-answering model in the above manner. Any suggestion on how I can use it?