Skip to content

Pull requests: pytorch/torchtitan

New pull request New
192 Open 1,533 Closed
192 Open 1,533 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

add option to use synthetic input data CLA Signed This label is managed by the Meta Open Source bot.
#1632 opened Aug 25, 2025 by alfuyao1986 Loading…
12
Distributed Scion/Muon CLA Signed This label is managed by the Meta Open Source bot.
#1630 opened Aug 25, 2025 by rakkit Loading…
29
workarounds for all2all autograd issues that Ruisi ran into CLA Signed This label is managed by the Meta Open Source bot.
#1604 opened Aug 20, 2025 by bdhirsh Loading…
1
[WIP] Activation Offloading with Separate Stream CLA Signed This label is managed by the Meta Open Source bot.
#1591 opened Aug 18, 2025 by excelle08 Loading…
2
Update SAC config to force save instead of recompute CLA Signed This label is managed by the Meta Open Source bot.
#1589 opened Aug 18, 2025 by soulitzer • Draft
1
Muon with 3D tensors CLA Signed This label is managed by the Meta Open Source bot.
#1584 opened Aug 16, 2025 by byronxu99 Loading…
2
[EP] add initial support for NVSHMEM-based all-to-all CLA Signed This label is managed by the Meta Open Source bot.
#1569 opened Aug 14, 2025 by tianyu-l Loading…
5
[Do Not Land] Debug for SDPA + CP nan issue in DeepSeekV3 CLA Signed This label is managed by the Meta Open Source bot.
#1566 opened Aug 13, 2025 by XilunWu • Draft
fix: remove redundant legacy usage of mp in checkpoint CLA Signed This label is managed by the Meta Open Source bot.
#1562 opened Aug 13, 2025 by yzs981130 Loading…
1
[PoC] Enable flexible different layout for same mesh via a util function CLA Signed This label is managed by the Meta Open Source bot.
#1550 opened Aug 11, 2025 by fduwjj Loading…
Adding logic for cleaning up FT checkpoints CLA Signed This label is managed by the Meta Open Source bot.
#1528 opened Aug 5, 2025 by bentherien Loading…
7
[WIP][Dion Official Optimizer, Muon] Integrate official Dion, and high speed Muon, optimizer impl with TorchTitan and Optimizer component class CLA Signed This label is managed by the Meta Open Source bot.
#1521 opened Aug 4, 2025 by lessw2020 • Draft
2
Fix semi-sync training with 1GPU per FT replica CLA Signed This label is managed by the Meta Open Source bot.
#1505 opened Jul 31, 2025 by bentherien Loading…
perf testing CLA Signed This label is managed by the Meta Open Source bot.
#1488 opened Jul 29, 2025 by ankitageorge • Draft
[Evaluation] Adding evaluation feature to TorchTitan CLA Signed This label is managed by the Meta Open Source bot.
#1470 opened Jul 28, 2025 by raymin0223 Loading…
25
[autoparallel] Enable bucketing passes for autoparallel, reorder and sink_waits. CLA Signed This label is managed by the Meta Open Source bot.
#1463 opened Jul 25, 2025 by IvanKobzarev Loading…
Autoparallel support for DP-only, DP+TP, or TP-only CLA Signed This label is managed by the Meta Open Source bot.
#1459 opened Jul 25, 2025 by IvanKobzarev Loading…
[WIP] Integrate autoparallel into torchtitan CLA Signed This label is managed by the Meta Open Source bot.
#1458 opened Jul 25, 2025 by IvanKobzarev Loading…
add lr logging CLA Signed This label is managed by the Meta Open Source bot.
#1453 opened Jul 24, 2025 by samsja Loading…
2
[DSV3] fix eos_id CLA Signed This label is managed by the Meta Open Source bot.
#1438 opened Jul 21, 2025 by XilunWu • Draft
1
[torchtitan] TorchFunctionMode + SAC issue CLA Signed This label is managed by the Meta Open Source bot.
#1434 opened Jul 21, 2025 by XilunWu Loading…
[torchtitan] CP + SDPA issue reproduce CLA Signed This label is managed by the Meta Open Source bot.
#1432 opened Jul 21, 2025 by XilunWu Loading…
[llama3] Add tied weights support CLA Signed This label is managed by the Meta Open Source bot.
#1409 opened Jul 17, 2025 by idoh • Draft
1
[WIP][Kernels] Add Quack (Cutlass 4.0) RMSNorm CLA Signed This label is managed by the Meta Open Source bot.
#1405 opened Jul 16, 2025 by lessw2020 • Draft
1
add float8 support CLA Signed This label is managed by the Meta Open Source bot.
#1378 opened Jul 10, 2025 by bdhirsh Loading…
1
ProTip! Exclude everything labeled bug with -label:bug.