Skip to content

Pull requests: pytorch/torchtitan

New pull request New
Clear current search query, filters, and sorts
159 Open 492 Closed
159 Open 492 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Add FSDP symmetric memory configuration and related tests ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3105 opened Apr 26, 2026 by crcrpar Contributor Loading…
11
[GraphTrainer][AutoDev] Add synthetic dataloader for precompile workflows ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3093 opened Apr 24, 2026 by SherlockNoMad Contributor • Draft
4 tasks done
add Flex Attention to torchtitan RL loop ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3077 opened Apr 23, 2026 by liangel-02 Contributor Loading…
1
44
Add tests for torchtitan/components/checkpoint.py ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3068 opened Apr 23, 2026 by Andrei-Aksionov Contributor Loading…
7
fix: normalize n_tokens_seen by cp_degree when context parallelism is… ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3009 opened Apr 17, 2026 by TryingtobeingNikhil Loading…
1
14
[moe] load-balancing aux loss ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3000 opened Apr 16, 2026 by pianpwk Contributor Loading…
34
Fix DTensor attr handling in make_fx tracer ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2998 opened Apr 16, 2026 by tugsbayasgalan Contributor Loading…
2
spmd types draft ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2988 opened Apr 15, 2026 by pianpwk Contributor • Draft
[demo] verify fully_shard([norm, head]) and fully_shard([tok_embedding, norm, head]) works with chunked loss ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2976 opened Apr 15, 2026 by weifengpy Contributor • Draft
Fix bug in _copy_fwd_metadata_to_bw_nodes ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2973 opened Apr 15, 2026 by yushangdi Contributor • Draft
Split graph trainer unit tests into dedicated workflows ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2971 opened Apr 15, 2026 by yiming0416 Contributor Loading…
Enable graph trainer passes for agnostic accelerators ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2968 opened Apr 14, 2026 by jemitche1 Loading…
3
[GraphTrainer][AutoDev] Add remove_transpose_pairs_pass graph pass ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2966 opened Apr 14, 2026 by yiming0416 Contributor Loading…
3 tasks done
[GraphTrainer][AutoDev] Add collapse_view_chains_pass for redundant view chain simplification ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2965 opened Apr 14, 2026 by yiming0416 Contributor Loading…
1 of 3 tasks
[autoresearch] Autobucketing reordering for aot_fx_trace (+3.9% TPS) ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2961 opened Apr 14, 2026 by SherlockNoMad Contributor • Draft
2 tasks
Add HF adapter checkpoint tests and loss_compare checkpoint resume su… ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2954 opened Apr 13, 2026 by mori360 Contributor Loading…
2
[Bug][EP][compile] non_blocking=True D2H race in input_splits under per-layer torch.compile bug Something isn't working ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot. module: torch.compile
#2951 opened Apr 13, 2026 by weifengpy Contributor Loading…
1
Bump pytest from 7.3.2 to 9.0.3 in /.ci/docker CLA Signed This label is managed by the Meta Open Source bot. dependencies Pull requests that update a dependency file python Pull requests that update python code
#2950 opened Apr 13, 2026 by dependabot Bot Loading…
Moe train module: rocm
#2939 opened Apr 12, 2026 by Acatsama0871 Loading…
1
[rl] Enable batch-invariant using FSDP to apply mixed precision ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2932 opened Apr 10, 2026 by wwwjn Contributor Loading…
6
[DO NOT REVIEW] Restore maybe_enable_amp for graph trainer after PR #2900 ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2927 opened Apr 10, 2026 by weifengpy Contributor Loading…
[LoRA]Add LoRA model converter with dynamic class inheritance ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2923 opened Apr 9, 2026 by mori360 Contributor • Draft
2
[GraphTrainer][AutoDev] Add gradient accumulation integration test ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2914 opened Apr 9, 2026 by SherlockNoMad Contributor • Draft
2 tasks
2
[GraphTrainer][AutoDev] Add DeepSeek-v3 AOT pass parity integration tests ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2913 opened Apr 9, 2026 by SherlockNoMad Contributor • Draft
2 tasks
[graph_trainer] autoresearch 2026-04-06 ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2862 opened Apr 7, 2026 by SherlockNoMad Contributor • Draft
ProTip! What’s not been updated in a month: updated:<2026-04-05.