demo 13b got wrong decoding

[WenchenLi]

Human: what is up
Assistant: hread水⊙ cabinetuetgruppeualsgtfür]] cosa Bedeut Initializeanno работы continentored auc族 Dok grantgc GoldOperation Couldbuild appearing Reformricstrittciendo ?? tutte namespaceResultasa cup!.(.atalLOCShould送"]; tablesgrandjavaxoireῖ эксichenPrimRoot¡ =\ збір był $(Ć parameter Ehe composectrLesblobcedureicityisa原 payment ^C

used IPFS version of llama here
but official delta from HF. applying the update followed the instructions and got the attached above

Any idea?

[zhisbug]

@WenchenLi Could you try the official llama from HF?

[WenchenLi]

yeah, i tried that one too https://huggingface.co/decapoda-research/llama-13b-hf
still the same

[WenchenLi]

by the way 7b version char is doing fine just the 13b version have that issue

[LovingThresh]

I had this problem one time yesterday. But when I rerun it today, it doesn't persist.

[WenchenLi]

I tired to rerun a few times. It doesn't help.> I had this problem one time yesterday. But when I rerun it today, it doesn't persist.

[zhisbug]

cool, Closing the issue. Please re-open if it happens again.