Skip to content

Pull requests: pytorch/torchtitan

New pull request New
81 Open 877 Closed
81 Open 877 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[WIP] expert parallel dp2ep CLA Signed This label is managed by the Meta Open Source bot.
#1324 opened Jun 21, 2025 by tianyu-l • Draft
Support finetuning from a pretrained model CLA Signed This label is managed by the Meta Open Source bot.
#1321 opened Jun 20, 2025 by vwxyzjn Loading…
2
[DSV3] Forward and backward pass for single GPU CLA Signed This label is managed by the Meta Open Source bot.
#1320 opened Jun 19, 2025 by wwwjn Loading…
12
[WIP] [float8] add float auto_filter_for_recipe CLA Signed This label is managed by the Meta Open Source bot.
#1319 opened Jun 18, 2025 by danielvegamyhre • Draft
1
Support different tokenizers CLA Signed This label is managed by the Meta Open Source bot.
#1318 opened Jun 18, 2025 by H-Huang Loading…
13
[not for land] testing out float8 128_1_128_128 blockwise scaling CLA Signed This label is managed by the Meta Open Source bot.
#1317 opened Jun 18, 2025 by vkuzo Loading…
Do not submit: Multinode training seems to be working CLA Signed This label is managed by the Meta Open Source bot.
#1314 opened Jun 17, 2025 by ahmadsharif1 • Draft
Do not submit: Multinode is working with multiple controllers CLA Signed This label is managed by the Meta Open Source bot.
#1313 opened Jun 17, 2025 by ahmadsharif1 • Draft
Add check for seq_len%tensor_parallel_degree==0 for parallelized Llama CLA Signed This label is managed by the Meta Open Source bot.
#1312 opened Jun 17, 2025 by jc-audet Loading…
9
[llama4][auxiliary-loss-free load balancing] update expert_bias without backward hooks CLA Signed This label is managed by the Meta Open Source bot.
#1304 opened Jun 16, 2025 by hann-wang Loading…
Finetune from pre-trained models CLA Signed This label is managed by the Meta Open Source bot.
#1300 opened Jun 15, 2025 by vwxyzjn Loading…
25
[not for land] Use new AC CLA Signed This label is managed by the Meta Open Source bot.
#1294 opened Jun 13, 2025 by soulitzer Loading…
WIP: Try to use monarch to run torchtitan. CLA Signed This label is managed by the Meta Open Source bot.
#1288 opened Jun 12, 2025 by ahmadsharif1 • Draft
[Do Not Merge] Test Titan changes to use DCP ZOC instead of titan default CLA Signed This label is managed by the Meta Open Source bot.
#1287 opened Jun 12, 2025 by Saiteja64 Loading…
2
DO NOT SUBMIT: WIP: Try to use monarch to run torchtitan. CLA Signed This label is managed by the Meta Open Source bot.
#1286 opened Jun 12, 2025 by ahmadsharif1 • Draft
[deepseek][kernels][blackwell] Cutlass blackwell grouped gemm using cute dsl (forward) CLA Signed This label is managed by the Meta Open Source bot.
#1276 opened Jun 8, 2025 by lessw2020 Loading…
6
[deepseek][blackwell] add Cutlass cute dsl blackwell dense based looping group gemm CLA Signed This label is managed by the Meta Open Source bot.
#1274 opened Jun 8, 2025 by lessw2020 Loading…
[deepseek][blackwell] add manual looping group gemm to enable base working inference on Blackwell CLA Signed This label is managed by the Meta Open Source bot.
#1272 opened Jun 7, 2025 by lessw2020 Loading…
[llama4] enable expert parallel on the same device mesh as tp (tp2ep) CLA Signed This label is managed by the Meta Open Source bot.
#1269 opened Jun 6, 2025 by hann-wang Loading…
5
Add support for creating ROCm docker image for torchtitan & enable ROCm CI support. CLA Signed This label is managed by the Meta Open Source bot. module: rocm
#1260 opened Jun 4, 2025 by akashveramd • Draft
3
[WIP][Blackwell Kernels] Blackwell group gemm and dense gemms with Python Cutlass CLA Signed This label is managed by the Meta Open Source bot.
#1256 opened Jun 3, 2025 by lessw2020 Loading…
alternative implementation of create_indices_from_offsets_nosync compatible with torch.compile CLA Signed This label is managed by the Meta Open Source bot.
#1251 opened Jun 1, 2025 by hann-wang Loading…
2
[float8] add float8 rowwise MoE prototype CLA Signed This label is managed by the Meta Open Source bot.
#1245 opened May 30, 2025 by danielvegamyhre Loading…
11
Add AMD GPU node for integration test CLA Signed This label is managed by the Meta Open Source bot.
#1241 opened May 29, 2025 by mori360 • Draft
7
[cp][flex_attention] integration test trial CLA Signed This label is managed by the Meta Open Source bot.
#1228 opened May 27, 2025 by XilunWu • Draft
ProTip! Add no:assignee to see everything that’s not assigned.