Skip to content

Pull requests: pytorch/torchtitan

New pull request New
Clear current search query, filters, and sorts
188 Open 1,540 Closed
188 Open 1,540 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

perf(pipeline): implement auto-partition algorithm CLA Signed This label is managed by the Meta Open Source bot. enhancement New feature or request
#2113 opened Dec 5, 2025 by TXacs Loading… updated Feb 2, 2026
24
Add peak flops for NVIDIA H20 GPUs CLA Signed This label is managed by the Meta Open Source bot.
#2307 opened Jan 31, 2026 by DamonFool Loading… updated Feb 2, 2026
[rl] GQA attention enablement in torchtitan vllm wrapper ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2299 opened Jan 29, 2026 by wwwjn Loading… updated Feb 2, 2026
5
Add ROCm CI support for Auto Parallel & Compiler Toolkit experiments ciflow/rocm-mi300 ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot. module: rocm
#2248 opened Jan 17, 2026 by akashveramd Loading… updated Feb 2, 2026
@akashveramd
3
Remove unnecessary token padding for MoE in BF16 mode CLA Signed This label is managed by the Meta Open Source bot.
#2255 opened Jan 20, 2026 by rakkit Loading… updated Jan 31, 2026
10
[HybridEP] Support hybridEP for GB200 with NVL72 CLA Signed This label is managed by the Meta Open Source bot.
#2207 opened Jan 8, 2026 by elfiegg Loading… updated Jan 31, 2026
@shuhuayu
20
[WIP][rl] refactor save and load model weights using DCP ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2221 opened Jan 13, 2026 by wwwjn Loading… updated Jan 30, 2026
9
[rl] refactor model registery ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2194 opened Jan 2, 2026 by wwwjn Loading… updated Jan 30, 2026
2
[rl] Using JobConfig as the centralized config system for inference and simple GRPO ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2191 opened Jan 2, 2026 by wwwjn Loading… updated Jan 30, 2026
31
[WIP][rl] refactor grader and trainer generator actor ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2244 opened Jan 16, 2026 by wwwjn Loading… updated Jan 30, 2026
13
[draft][lora] Apply LoraLinear as a wrapper of Linear ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2288 opened Jan 28, 2026 by mori360 • Draft updated Jan 30, 2026
[Typing] Fix pyrefly ignores in deepseek model.py ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2305 opened Jan 30, 2026 by fegin Loading… updated Jan 30, 2026
2
feat(gpt-oss): add YaRN RoPE extensions with mscale for extended context CLA Signed This label is managed by the Meta Open Source bot.
#2216 opened Jan 8, 2026 by eous Loading… updated Jan 30, 2026
14
[rl] Add numerics test against vllm native inference ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2300 opened Jan 29, 2026 by wwwjn Loading… updated Jan 30, 2026
Add Transformer-Engine Fused_Adam Optimizer Support CLA Signed This label is managed by the Meta Open Source bot.
#2293 opened Jan 29, 2026 by vivekgoe • Draft updated Jan 30, 2026
1
[LoRA] Add LoRA converter for LoRA finetuning ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2263 opened Jan 20, 2026 by mori360 Loading… updated Jan 30, 2026
37
[WIP][FSDP2] enable per-param mesh FSDP2 for MoE and per-layer compile ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2281 opened Jan 28, 2026 by weifengpy • Draft updated Jan 29, 2026
Enable graph_pp for autoparallel in torchtitan ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2271 opened Jan 23, 2026 by sanketpurandare • Draft updated Jan 29, 2026
Staging SFT training CLA Signed This label is managed by the Meta Open Source bot.
#2148 opened Dec 12, 2025 by rakkit Loading… updated Jan 29, 2026
106
fix: enable torch.autocast for TP parallelism without FSDP CLA Signed This label is managed by the Meta Open Source bot.
#2213 opened Jan 8, 2026 by eous Loading… updated Jan 28, 2026
5
[SimpleFSDP] add CI to guard compiler optimization passes CLA Signed This label is managed by the Meta Open Source bot.
#2072 opened Nov 20, 2025 by ruisizhang123 Loading… updated Jan 25, 2026
15
feat(moe): add topk_before_score routing and use_router_bias support CLA Signed This label is managed by the Meta Open Source bot.
#2212 opened Jan 8, 2026 by eous Loading… updated Jan 25, 2026
@shuhuayu
27
[DeepEP Integration] Free cache after combine for forward only path. CLA Signed This label is managed by the Meta Open Source bot.
#2274 opened Jan 25, 2026 by elfiegg • Draft updated Jan 25, 2026
feat: add differential learning rate and weight decay support CLA Signed This label is managed by the Meta Open Source bot.
#2210 opened Jan 8, 2026 by eous Loading… updated Jan 26, 2026
13
[mxfp8 moe training] temp workaround: don't compile GroupedExperts ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2268 opened Jan 21, 2026 by danielvegamyhre Loading… updated Jan 24, 2026
5
ProTip! Find all pull requests that aren't related to any open issues with -linked:issue.