InternLM inference and training are problematic

[June01]

The following is my code to run the demo, with pretrained model, llama_config, tokenizer. However, the output of the network is chaos even with a simple Question "hello". Could you please look into it?

torchrun --nproc-per-node=1  demos/single_turn.py \
--llama_config /path/to/params.json --tokenizer_path /path/to/tokenizer.model \
--pretrained_path /path/to/alpaca_finetuned

[ChrisLiu6]

You are now loading internlm checkpoint to a llama model, Please try adding --llama_type internlm.

[June01]

Thanks! It works.

…

On Tue, 26 Sept 2023 at 18:41, Chris Liu ***@***.***> wrote: You are now loading internlm checkpoint to a llama model, Please try adding --llama_type internlm. — Reply to this email directly, view it on GitHub <#78 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AC5TQGHNEZVCK3NT4ADTAP3X4KWN5ANCNFSM6AAAAAA5HIE6Y4> . You are receiving this because you authored the thread.Message ID: ***@***.***>