Inference Colab file of ARDM

[Aditya6500]

I am faces few issues in ARDM Inference file of colab
I am getting error while using
model_A.load_state_dict(model_A_states)
model_B.load_state_dict(model_B_states).
Its unable to match all the keys.
I tried adding strict = False

model_A.load_state_dict(model_A_states,strict =False)
model_B.load_state_dict(model_B_states , strict = False)
The code runs but few keys don't match.
On proceeding in this manner I am facing error here
logits, past = model_A(prev_input, past=past)
error : past argument not supported. I tried removing past argument
but it gives error for the next line of code.
logits = logits[:, -1, :] / temperature

Can you please help me fix this code.

[qywu]

You might need to use a older version of transformers to load the weights correctly.

[Aditya6500]

Thank you so much , Version 2.2.2 worked.

…

On Mon, 1 May 2023 at 23:54, qingyang ***@***.***> wrote: You might need to use a older version of transformers to load the weights correctly. — Reply to this email directly, view it on GitHub <#6 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AXGSWBMLZDBDZ62X6EJFQLLXD75VVANCNFSM6AAAAAAXRPVOTA> . You are receiving this because you authored the thread.Message ID: ***@***.***>