Not able to access the pretrained models via the links.

[dingusagar]

Was trying to access the pretrained checkpoints at this link as mentioned in the readMe.
https://msralaphilly2.blob.core.windows.net/release/BioGPT/checkpoints/QA-PubMedQA-BioGPT.tgz

But getting the error that it is not accessible publicly.

[lewislovelock]

if you want to fine-tune this model, you can check this notebook, https://github.com/huggingface/notebooks/blob/main/examples/language_modeling.ipynb -- just change the model and datasets, i already tried it works 💯

[dingusagar]

@lewislovelock , I wanted to finetune the base versions of biogpt. but it looks like huggingface has only the biogpt large checkpoints. Looks like not all the checkpoints in the readME are openly available.

[lewislovelock]

@lewislovelock , I wanted to finetune the base versions of biogpt. but it looks like huggingface has only the biogpt large checkpoints. Looks like not all the checkpoints in the readME are openly available.

from transformers import BioGptTokenizer, BioGptForCausalLM
from datasets import load_dataset

datasets = load_dataset('YOUR_DATASET')
model = BioGptForCausalLM.from_pretrained("microsoft/biogpt")
......

https://huggingface.co/microsoft/biogpt/tree/main
emmm, is this not the base version?

[dingusagar]

@lewislovelock
All the links in readme seem to be working now when I checked. Looks like the issue is fixed. Thanks