Skip to content

🐛 [Bug]Torch distributed data parallel accelerate GPT2 example failing #3865

@apbose

Description

@apbose

Torch distributed data parallel accelerate GPT2 example failing

cd examples/distributed_inference
CUDA_VISIBLE_DEVICES=0 accelerate launch data_parallel_gpt2.py <single GPU>
accelerate launch data_parallel_gpt2.py

torch 2.9.0.dev20250821+cu129
torch_tensorrt 2.10.0.dev0+0
accelerate 1.10.1

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions