Skip to content

Pull requests: pytorch/torchtitan

New pull request New
Clear current search query, filters, and sorts
221 Open 1,626 Closed
221 Open 1,626 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Integrate DeepEP to torchtitan CLA Signed This label is managed by the Meta Open Source bot.
#2107 by elfiegg was merged Dec 18, 2025 Loading…
158
VLM: Onboarding native resolution, native aspect ratio, interleaved VLM training CLA Signed This label is managed by the Meta Open Source bot.
#1615 by lkhphuc was merged Sep 22, 2025 Loading…
1 task done
135
[BC Breaking] Config System Refactor: TOML to Python Dataclass Registry ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2386 by tianyu-l was merged Feb 23, 2026 Loading… New Feature, Model, Misc
@tianyu-l
126
Use new DeviceMesh unflatten to rewrite parallel_dims ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#1660 by fegin was merged Dec 17, 2025 Loading…
117
[rl] Use torchtitan config system for inference and simple GRPO ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2191 by wwwjn was closed Feb 28, 2026 Loading…
111
add support for simplefsdp+ep CLA Signed This label is managed by the Meta Open Source bot.
#1529 by ruisizhang123 was merged Sep 30, 2025 Loading…
88
Adding Qwen3 model to the experiments folder CLA Signed This label is managed by the Meta Open Source bot.
#1429 by HosseinKaviani-H was merged Aug 18, 2025 Loading…
1
85
Support gradient accumulation CLA Signed This label is managed by the Meta Open Source bot.
#1238 by janEbert was merged Jun 5, 2025 Loading…
1
84
[rl][combo] Refactor simple RL loop with torchtitan components ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2443 by wwwjn was merged Feb 28, 2026 Loading…
84
Adding OBELICS DataLoader CLA Signed This label is managed by the Meta Open Source bot.
#663 by TJ-Solergibert was merged Mar 31, 2025 Loading…
1
76
Add FusedRMSNorm (Triton kernel, +15% eager), Add NPLayerNorm, Enable config selectable Norm Type CLA Signed This label is managed by the Meta Open Source bot.
#181 by lessw2020 was merged Apr 5, 2024 Loading…
73
adding variable length attention to llama3 8b CLA Signed This label is managed by the Meta Open Source bot.
#2000 by liangel-02 was merged Nov 21, 2025 Loading…
73
Fix loss computation by handling valid token imbalance in train loop ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2206 by wwwjn was merged Jan 26, 2026 Loading…
66
Run vLLM inference using torchtitan model definition (single GPU) ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2119 by wwwjn was merged Dec 16, 2025 Loading…
66
gpt-oss model enablement CLA Signed This label is managed by the Meta Open Source bot.
#1754 by wwwjn was merged Oct 22, 2025 Loading…
66
Supports block causal mask CLA Signed This label is managed by the Meta Open Source bot.
#1001 by fegin was merged Apr 3, 2025 Loading…
64
basic validator implementation CLA Signed This label is managed by the Meta Open Source bot.
#1362 by wesleytruong was merged Jul 10, 2025 Loading…
1
59
[WIP] Integrate DeepGEMM, add supporting utils and unit testing, to enable blockwise fp8 inference CLA Signed This label is managed by the Meta Open Source bot.
#1124 by lessw2020 was merged Apr 24, 2025 Loading…
59
Enable PP and EP overlap for MoE CLA Signed This label is managed by the Meta Open Source bot.
#1721 by H-Huang was merged Dec 12, 2025 Loading…
58
Refactor attention and make attention mask an argument to the model CLA Signed This label is managed by the Meta Open Source bot.
#1776 by fegin was merged Oct 10, 2025 Loading…
1
57
TorchTitan e2e test on torchcomms device mesh CLA Signed This label is managed by the Meta Open Source bot. fb-exported meta-exported
#1847 by mori360 was merged Oct 14, 2025 Loading…
57
Enable static type checking with Pyrefly CLA Signed This label is managed by the Meta Open Source bot.
#2136 by rchen152 was merged Dec 12, 2025 Loading…
55
[SimpleFSDP] add manual bucketing pass CLA Signed This label is managed by the Meta Open Source bot.
#1881 by ruisizhang123 was merged Nov 16, 2025 Loading…
2 of 4 tasks
55
Second version of degub/deterministic configs. CLA Signed This label is managed by the Meta Open Source bot.
#1807 by githubsgi was merged Oct 29, 2025 Loading…
1
55
Use stateful dataloader to checkpoint data iteration order and token buffer CLA Signed This label is managed by the Meta Open Source bot.
#279 by gokulavasan was merged May 21, 2024 Loading…
1
54
ProTip! Mix and match filters to narrow down what you’re looking for.