Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

No such file or directory: '/mtn/workplace/qwen-ckpts/qwen-14b-hf-to-megatron-tp2-pp1/release/mp_rank_00/model_optim_rng.pt #124

Closed
jamestch opened this issue Jan 30, 2024 · 2 comments
Closed

No such file or directory: '/mtn/workplace/qwen-ckpts/qwen-14b-hf-to-megatron-tp2-pp1/release/mp_rank_00/model_optim_rng.pt #124

jamestch opened this issue Jan 30, 2024 · 2 comments

Comments

@jamestch
Copy link

按照教程将模型从hf格式转换成megaton格式。然后单机多卡预训练。报错：
[Errno 2] No such file or directory: '/mtn/workplace/qwen-ckpts/qwen-14b-hf-to-megatron-tp2-pp1/release/mp_rank_00/model_optim_rng.pt'。该目录下实际文件为model_rng.pt
@jamestch jamestch changed the title No such file or directory: '/llm-data/workplace/qwen-ckpts/qwen-14b-hf-to-megatron-tp2-pp1/release/mp_rank_00/model_optim_rng.pt No such file or directory: '/mtn/workplace/qwen-ckpts/qwen-14b-hf-to-megatron-tp2-pp1/release/mp_rank_00/model_optim_rng.pt Jan 30, 2024
@jerryli1981
Copy link
Collaborator

您好，这是因为convert的时候的save的ckpt的命名不带optim，这个已经修复了，还没提交。您那边急用的话可以手工改下

@jerryli1981
Copy link
Collaborator

您好，问题已修复，请pull下最新的代码按照Quick Start的指引再试下

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@jamestch @jerryli1981