Skip to content

[bugfix] Fix multinode write conflict mcore-bridge (deepseek-v3) #6626

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
Nov 17, 2025
Merged

[bugfix] Fix multinode write conflict mcore-bridge (deepseek-v3) #6626

Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
31258f0
update peft version
Jintao-Huang Nov 17, 2025
f9f8231
fix multinode write_conflict mcore_bridge
Jintao-Huang Nov 17, 2025
9f06b13
Merge branch 'main' into fix_multinode_write_conflict
Jintao-Huang Nov 17, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions swift/megatron/model/gpt_bridge.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@
from transformers.modeling_utils import custom_object_save

from swift.llm import deep_getattr, get_model_tokenizer, safe_snapshot_download, save_checkpoint
from swift.utils import disable_safe_ddp_context_use_barrier, get_logger, is_last_rank
from swift.utils import get_logger, is_last_rank
from ..tuners import LoraParallelLinear
from ..utils import SafetensorLazyLoader, StreamingSafetensorSaver

Expand Down Expand Up @@ -65,7 +65,7 @@ def __init__(self, disable_tqmd: bool = False):
self.ep_rank = mpu.get_expert_model_parallel_rank()

def _init_meta_hf_model(self):
with torch.device('meta'), disable_safe_ddp_context_use_barrier():
with torch.device('meta'):
self.hf_model, self.processor = get_model_tokenizer(
self.args.model_dir, model_type=self.args.hf_model_type, return_dummy_model=True)

Expand Down
Loading