Repository navigation
Troubleshooting
Sudhanshu edited this page Nov 11, 2026
·
1 revision
| Symptom | Cause / action |
|---|---|
fatal: not a git repository |
An extracted ZIP has no .git; clone the code repository or Wiki separately. See Publishing-the-Wiki. |
Wiki script says it cannot find wiki/Home.md
|
Run the launcher from the extracted repository package, or use its .cmd wrapper that locates paths relative to itself. |
| PowerShell script not digitally signed | Inspect the script and use the included .cmd publisher which sets policy for its own process only. |
| Old temporary Wiki clone blocks publishing | Included script creates a fresh unique checkout per run and cleans up in finally. |
torch.cuda.is_available() is false |
The active PyTorch installation may be CPU-only; install a supported CUDA build separately. |
LOCAL_RANK exceeds GPU count |
Reduce --nproc_per_node, or use multi-rank --cpu for demonstration. |
| NCCL error on Windows | The script chooses Gloo on Windows; Linux CUDA uses NCCL. |
Missing transformers or peft
|
Install Qwen optional dependencies into the active interpreter. |
| Qwen out of memory | Reduce per-device batch size and sequence length, use appropriate hardware; DDP does not combine VRAM. |
| Hang at collective | Ensure every rank reaches corresponding DDP backward and loss AllReduce operations; use consistent step counts. |
Missing requirements.txt in original ZIP |
Uploaded file is llm_ddp_requirements_.txt; repository package supplies an unchanged-content requirements.txt alias. |
The Wiki has its own Git repository ending in .wiki.git. Uploading Markdown files to the code repository alone does not create Wiki pages.
Distributed LLM Training · PyTorch DDP (educational) — Home · System-Architecture · Low-Level-Design · Publishing-the-Wiki
This project is licensed under the Apache License, Version 2.0.© 2026 Sudhanshu Shukla · Licensed under the Apache License, Version 2.0.