Skip to content

请问使用lora微调中断后,如何在checkpoint继续进行训练? #1363

@eynewnil

Description

@eynewnil

我用的qwen官方脚本对qwen-7B-chat进行lora微调,中间微调中断了,要如何从checkpoint继续微调呢?
我尝试设置trainer.train(resume_from_checkpoint=True),但是会报错:RuntimeError: Error(s) in loading state_dict for PeftModelForCausalLM:
Missing key(s) in state_dict(在尝试恢复训练时,这些状态与当前模型的结构不匹配。)

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions