Skip to content

Pull requests: pytorch/torchtitan

New pull request New
Clear current search query, filters, and sorts
160 Open 1,427 Closed
160 Open 1,427 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Experimental Feature] Huggingface model training CLA Signed This label is managed by the Meta Open Source bot.
#919 opened Mar 3, 2025 by junjzhang Loading…
1
59 👍 8
IBM experimental dataloaders CLA Signed This label is managed by the Meta Open Source bot.
#376 opened May 31, 2024 by daviswer Loading…
30 👍 6
[torchtitan][debug] integrated CommDebugMode into TorchTitan CLA Signed This label is managed by the Meta Open Source bot.
#480 opened Jul 24, 2024 by sinhaanshul Loading…
8 👍 3
[DO NOT REVIEW] debug fsdp2 checkpoint for uneven sharding CLA Signed This label is managed by the Meta Open Source bot.
#1635 opened Aug 25, 2025 by weifengpy • Draft
1
👍 3
Distributed Scion/Muon CLA Signed This label is managed by the Meta Open Source bot.
#1630 opened Aug 25, 2025 by rakkit Loading…
27 👍 3
Enable PP and EP overlap for MoE CLA Signed This label is managed by the Meta Open Source bot.
#1721 opened Sep 18, 2025 by H-Huang Loading…
35 👍 3
[WIP] zero bubble CLA Signed This label is managed by the Meta Open Source bot.
#546 opened Aug 20, 2024 by H-Huang • Draft
👍 2
[PoC] Enable flexible different layout for same mesh via a util function CLA Signed This label is managed by the Meta Open Source bot.
#1550 opened Aug 11, 2025 by fduwjj Loading…
👍 2
[llama3] Add tied weights support CLA Signed This label is managed by the Meta Open Source bot.
#1409 opened Jul 17, 2025 by idoh • Draft
1 👍 2
[llama4][auxiliary-loss-free load balancing] update expert_bias without backward hooks CLA Signed This label is managed by the Meta Open Source bot.
#1304 opened Jun 16, 2025 by hann-wang Loading…
👍 2
Add shims for PyTorch stable CLA Signed This label is managed by the Meta Open Source bot.
#1862 opened Oct 13, 2025 by bwasti Loading…
👍 2
[Float8] Fix intermediate Float8 checkpoint loading CLA Signed This label is managed by the Meta Open Source bot.
#1414 opened Jul 18, 2025 by jquesnelle Loading…
6 👍 2
Run vLLM inference using torchtitan model definition (single GPU) CLA Signed This label is managed by the Meta Open Source bot.
#2119 opened Dec 5, 2025 by wwwjn • Draft
18 👍 2
Support finetuning from a pretrained model CLA Signed This label is managed by the Meta Open Source bot.
#1321 opened Jun 20, 2025 by vwxyzjn Loading…
20 👍 1
[PP] microbatch split config CLA Signed This label is managed by the Meta Open Source bot.
#947 opened Mar 7, 2025 by H-Huang • Draft
2 👍 1
[Not for landing] piggy back on titan for scale init test CLA Signed This label is managed by the Meta Open Source bot.
#841 opened Feb 13, 2025 by fduwjj • Draft
2
updates here CLA Signed This label is managed by the Meta Open Source bot.
#417 opened Jun 24, 2024 by H-Huang • Draft
1
WIP change to run a zero-bubble like schedule CLA Signed This label is managed by the Meta Open Source bot.
#416 opened Jun 21, 2024 by wconstab Loading…
3d with fp8 in test runner CLA Signed This label is managed by the Meta Open Source bot.
#564 opened Aug 29, 2024 by H-Huang • Draft
add pp validation for schedule CLA Signed This label is managed by the Meta Open Source bot.
#568 opened Sep 5, 2024 by H-Huang Loading…
3
[WIP] Allow benchmark between multiple configs CLA Signed This label is managed by the Meta Open Source bot.
#703 opened Nov 26, 2024 by H-Huang Loading…
2
[DO NOT MERGE][example] fold batch and sequence dimensions to accelerate Sequence Parallel CLA Signed This label is managed by the Meta Open Source bot.
#437 opened Jul 4, 2024 by tianyu-l Loading…
7
[MoE][PoC] Expert Parallel: tp and tp2ep CLA Signed This label is managed by the Meta Open Source bot.
#731 opened Dec 12, 2024 by tianyu-l • Draft
[MoE][PoC] model code CLA Signed This label is managed by the Meta Open Source bot.
#730 opened Dec 12, 2024 by tianyu-l • Draft
4
[MoE][PoC] Expert Parallel: dp2ep CLA Signed This label is managed by the Meta Open Source bot.
#732 opened Dec 12, 2024 by tianyu-l • Draft
7
ProTip! Follow long discussions with comments:>50.