The state dictionary of the model you are training to load is corrupted.

[marcussyeo]

Hello I'm interested to test out the PRIMER model but when I followed the steps accordingly, I ended up getting

"ValueError: The state dictionary of the model you are training to load is corrupted. Are you sure it was properly saved?"

I've tried reinstalling the PRIMER-large packages too but to no avail. Did anyone encounter the same issue?

[marcussyeo]

from transformers import AutoTokenizer
from transformers import LEDForConditionalGeneration, LEDConfig
tokenizer = AutoTokenizer.from_pretrained('./PRIMER/')
config = LEDConfig.from_pretrained('./PRIMER/')
model = LEDForConditionalGeneration.from_pretrained('./PRIMER/', config=config)

^this is my code but i got a ValueError saying that my model is corrupted. Tried on both windows and linux but both don't work.

[Wendy-Xiao]

Hi, you can follow the instruction on usage of PRIMER in readme.md. Basically, we used the original Longformer implementation instead of huggingface version. So please install Longformer by pip install git+https://github.com/allenai/longformer.git

[giammi56]

@MYB0SS I am starring using PRIMER too, but I am not able to feed it with multiple texts as inputs to summarize. Could you share how you did it?