Skip to content

Pull requests: pytorch/torchtitan

New pull request New
Clear current search query, filters, and sorts
24 Open 30 Closed
24 Open 30 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[LoRA] Add LoRA converter for LoRA finetuning ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2263 opened Jan 20, 2026 by mori360 Loading…
37
fix: enable torch.autocast for TP parallelism without FSDP CLA Signed This label is managed by the Meta Open Source bot.
#2213 opened Jan 8, 2026 by eous Loading…
5
feat(moe): add topk_before_score routing and use_router_bias support CLA Signed This label is managed by the Meta Open Source bot.
#2212 opened Jan 8, 2026 by eous Loading…
@shuhuayu
27
feat: add differential learning rate and weight decay support CLA Signed This label is managed by the Meta Open Source bot.
#2210 opened Jan 8, 2026 by eous Loading…
13
feat(gpt-oss): Add CPU offload optimizer, differential LR/WD, and more CLA Signed This label is managed by the Meta Open Source bot.
#2205 opened Jan 7, 2026 by eous Loading…
31
auto-chunk unembed & loss ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2186 opened Dec 29, 2025 by shunting314 Loading…
11
Add epoch-based training support
#2182 opened Dec 28, 2025 by yurekami Loading…
5 tasks
1
8
Staging SFT training CLA Signed This label is managed by the Meta Open Source bot.
#2148 opened Dec 12, 2025 by rakkit Loading…
106
[simple_fsdp] Turn on bucketing by default CLA Signed This label is managed by the Meta Open Source bot.
#2103 opened Dec 3, 2025 by IvanKobzarev Loading…
11
[SimpleFSDP] add CI to guard compiler optimization passes CLA Signed This label is managed by the Meta Open Source bot.
#2072 opened Nov 20, 2025 by ruisizhang123 Loading…
15
add inductor lite mode CLA Signed This label is managed by the Meta Open Source bot.
#2005 opened Nov 8, 2025 by BoyuanFeng • Draft
16
fix imports in components/checkpoint.py CLA Signed This label is managed by the Meta Open Source bot.
#1844 opened Oct 9, 2025 by saforem2 Loading…
4
[VLM] Refactor special tokens by subclassing Tokenizer CLA Signed This label is managed by the Meta Open Source bot.
#1802 opened Oct 6, 2025 by lkhphuc Loading…
19
Docs: Add comprehensive troubleshooting guide CLA Signed This label is managed by the Meta Open Source bot.
#1801 opened Oct 6, 2025 by khlaifiabilel Loading…
10 tasks done
20
Adding config options for deterministic execution CLA Signed This label is managed by the Meta Open Source bot.
#1761 opened Sep 26, 2025 by githubsgi Loading…
7
[torchtitan][replicate] experimenting new replicate integration with torchtitan CLA Signed This label is managed by the Meta Open Source bot.
#1714 opened Sep 15, 2025 by anshul-si Loading…
29
code refactor : making key steps modular train_step() CLA Signed This label is managed by the Meta Open Source bot. fb-exported
#1650 opened Aug 28, 2025 by Shagun-G Loading…
5
add option to use synthetic input data CLA Signed This label is managed by the Meta Open Source bot.
#1632 opened Aug 25, 2025 by alfuyao1986 Loading…
12
Distributed Scion/Muon CLA Signed This label is managed by the Meta Open Source bot.
#1630 opened Aug 25, 2025 by rakkit Loading…
29
Adding logic for cleaning up FT checkpoints CLA Signed This label is managed by the Meta Open Source bot.
#1528 opened Aug 5, 2025 by bentherien Loading…
7
Finetune from pre-trained models CLA Signed This label is managed by the Meta Open Source bot.
#1300 opened Jun 15, 2025 by vwxyzjn Loading…
25
compile: turn off fullgraph=True to support llama4 CLA Signed This label is managed by the Meta Open Source bot.
#1182 opened May 12, 2025 by bdhirsh Loading…
20
Adding Llama 1B and 3B model. CLA Signed This label is managed by the Meta Open Source bot.
#1040 opened Apr 1, 2025 by githubsgi Loading…
10
Hpc setup CLA Signed This label is managed by the Meta Open Source bot.
#1004 opened Mar 22, 2025 by githubsgi Loading…
11
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.