Skip to content

Pull requests: pytorch/torchtitan

New pull request New
Clear current search query, filters, and sorts
192 Open 1,533 Closed
192 Open 1,533 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

IBM experimental dataloaders CLA Signed This label is managed by the Meta Open Source bot.
#376 opened May 31, 2024 by daviswer Loading…
30
Add PP tracer + DP test CLA Signed This label is managed by the Meta Open Source bot.
#379 opened Jun 1, 2024 by kwen2501 Loading…
5
WIP change to run a zero-bubble like schedule CLA Signed This label is managed by the Meta Open Source bot.
#416 opened Jun 21, 2024 by wconstab Loading…
updates here CLA Signed This label is managed by the Meta Open Source bot.
#417 opened Jun 24, 2024 by H-Huang • Draft
1
Add load from HF ckpts to FSDP model fails. CLA Signed This label is managed by the Meta Open Source bot.
#427 opened Jun 25, 2024 by MinghaoYan • Draft
[DO NOT MERGE][example] fold batch and sequence dimensions to accelerate Sequence Parallel CLA Signed This label is managed by the Meta Open Source bot.
#437 opened Jul 4, 2024 by tianyu-l Loading…
7
Updates to support new sdpa function CLA Signed This label is managed by the Meta Open Source bot.
#458 opened Jul 13, 2024 by jainapurva • Draft
3
[not for land] TE experiments CLA Signed This label is managed by the Meta Open Source bot.
#477 opened Jul 23, 2024 by vkuzo Loading…
[torchtitan][debug] integrated CommDebugMode into TorchTitan CLA Signed This label is managed by the Meta Open Source bot.
#480 opened Jul 24, 2024 by sinhaanshul Loading…
8
[DO NOT REVIEW] Runtime estimation with FakeTensor + TorchDispatchMode CLA Signed This label is managed by the Meta Open Source bot.
#536 opened Aug 20, 2024 by weifengpy Loading…
[WIP] zero bubble CLA Signed This label is managed by the Meta Open Source bot.
#546 opened Aug 20, 2024 by H-Huang • Draft
3d with fp8 in test runner CLA Signed This label is managed by the Meta Open Source bot.
#564 opened Aug 29, 2024 by H-Huang • Draft
add pp validation for schedule CLA Signed This label is managed by the Meta Open Source bot.
#568 opened Sep 5, 2024 by H-Huang Loading…
3
[not for land yet] hack max and abs out of ops eligible for AC CLA Signed This label is managed by the Meta Open Source bot.
#580 opened Sep 17, 2024 by vkuzo Loading…
[DO NOT REVIEW] --experimental.fsdp_sharding_on_largest_dim CLA Signed This label is managed by the Meta Open Source bot.
#607 opened Oct 9, 2024 by weifengpy Loading…
[not for land] TE experiments, take 2 CLA Signed This label is managed by the Meta Open Source bot.
#614 opened Oct 14, 2024 by vkuzo Loading…
[DO NOT REVIEW] gaps to enable FDSP2 cpu offloading CLA Signed This label is managed by the Meta Open Source bot.
#622 opened Oct 16, 2024 by weifengpy Loading…
1
1
[not for land] torch.compile individual linears CLA Signed This label is managed by the Meta Open Source bot.
#661 opened Oct 29, 2024 by vkuzo Loading…
[WIP] Allow benchmark between multiple configs CLA Signed This label is managed by the Meta Open Source bot.
#703 opened Nov 26, 2024 by H-Huang Loading…
2
First draft Auto-SAC workflow CLA Signed This label is managed by the Meta Open Source bot.
#710 opened Dec 2, 2024 by sanketpurandare • Draft
4
[MoE][PoC] model code CLA Signed This label is managed by the Meta Open Source bot.
#730 opened Dec 12, 2024 by tianyu-l • Draft
4
[MoE][PoC] Expert Parallel: tp and tp2ep CLA Signed This label is managed by the Meta Open Source bot.
#731 opened Dec 12, 2024 by tianyu-l • Draft
[MoE][PoC] Expert Parallel: dp2ep CLA Signed This label is managed by the Meta Open Source bot.
#732 opened Dec 12, 2024 by tianyu-l • Draft
7
[Not for land] Integrate float8nocompile, an experimental feature for high performance CLA Signed This label is managed by the Meta Open Source bot.
#778 opened Jan 7, 2025 by danielvegamyhre Loading…
8
Register backward hook for the whole optim_dict to enable working at multi schedule pp CLA Signed This label is managed by the Meta Open Source bot.
#780 opened Jan 7, 2025 by mori360 • Draft
ProTip! Find all pull requests that aren't related to any open issues with -linked:issue.