-
Notifications
You must be signed in to change notification settings - Fork 115
Pull requests: pytorch/torchtitan
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
Enable CP
CLA Signed
This label is managed by the Meta Open Source bot.
#433
opened Jun 27, 2024 by
fegin
Loading…
Add support of DDP and experimental CompiledAutograd
CLA Signed
This label is managed by the Meta Open Source bot.
#432
opened Jun 27, 2024 by
fegin
Loading…
Add load from HF ckpts to FSDP model fails.
CLA Signed
This label is managed by the Meta Open Source bot.
#427
opened Jun 25, 2024 by
MinghaoYan
•
Draft
WIP change to run a zero-bubble like schedule
CLA Signed
This label is managed by the Meta Open Source bot.
#416
opened Jun 21, 2024 by
wconstab
Loading…
[POC] Showed more memory efficient FSDP wrapping
CLA Signed
This label is managed by the Meta Open Source bot.
Add PP tracer + DP test
CLA Signed
This label is managed by the Meta Open Source bot.
#379
opened Jun 1, 2024 by
kwen2501
Loading…
IBM experimental dataloaders
CLA Signed
This label is managed by the Meta Open Source bot.
#376
opened May 31, 2024 by
daviswer
Loading…
expose optimizer params, log optimizer type and settings for the run
CLA Signed
This label is managed by the Meta Open Source bot.
#365
opened May 26, 2024 by
lessw2020
Loading…
selective compilation - norm layers only
CLA Signed
This label is managed by the Meta Open Source bot.
#320
opened May 10, 2024 by
lessw2020
Loading…
register fused rmsnorm as pytorch custom op
CLA Signed
This label is managed by the Meta Open Source bot.
[wip] differentiate Rstd vs rstd
CLA Signed
This label is managed by the Meta Open Source bot.
#294
opened May 2, 2024 by
lessw2020
Loading…
[RFC] Sharded embeddings in separate FSDP group
CLA Signed
This label is managed by the Meta Open Source bot.
run sdpa with dtensor
CLA Signed
This label is managed by the Meta Open Source bot.
#180
opened Mar 30, 2024 by
tianyu-l
Loading…
ProTip!
Add no:assignee to see everything that’s not assigned.