Search results

Remove unnecessary token padding for MoE in BF16 mode

CLA SignedThis label is managed by the Meta Open Source bot.This label is managed by the Meta Open Source bot.

high priority

Status: Open (in progress).

pytorch/torchtitannumber 2255

#2255 In pytorch/torchtitan;

· rakkit opened on Jan 20, 2026

·  

Bugs, Composability

Staging SFT training

CLA SignedThis label is managed by the Meta Open Source bot.This label is managed by the Meta Open Source bot.

Status: Open (in progress).

pytorch/torchtitannumber 2148

#2148 In pytorch/torchtitan;

· rakkit opened on Dec 12, 2025

[forge] allow torchforges to set checkpoint base folder

CLA SignedThis label is managed by the Meta Open Source bot.This label is managed by the Meta Open Source bot.

Status: Merged (completed).

pytorch/torchtitannumber 2131

#2131 In pytorch/torchtitan;

· by rakkit was closed on Dec 9, 2025

add all SDPA backends to op_sac_save_list

CLA SignedThis label is managed by the Meta Open Source bot.This label is managed by the Meta Open Source bot.

Status: Merged (completed).

pytorch/torchtitannumber 2095

#2095 In pytorch/torchtitan;

· by rakkit was closed on Dec 1, 2025

Improve logging by formatting the dict as JSON.

CLA SignedThis label is managed by the Meta Open Source bot.This label is managed by the Meta Open Source bot.

Status: Merged (completed).

pytorch/torchtitannumber 2094

#2094 In pytorch/torchtitan;

· by rakkit was closed on Dec 1, 2025

[moe] brings batch/sequence-wise load balance loss

CLA SignedThis label is managed by the Meta Open Source bot.This label is managed by the Meta Open Source bot.

Status: Open (in progress).

pytorch/torchtitannumber 2061

#2061 In pytorch/torchtitan;

· rakkit opened on Nov 19, 2025

Fake balanced routing in MoE

CLA SignedThis label is managed by the Meta Open Source bot.This label is managed by the Meta Open Source bot.

Status: Merged (completed).

pytorch/torchtitannumber 1670

#1670 In pytorch/torchtitan;

· by rakkit was closed on Oct 3, 2025

Distributed Scion/Muon

CLA SignedThis label is managed by the Meta Open Source bot.This label is managed by the Meta Open Source bot.

Status: Open (in progress).

pytorch/torchtitannumber 1630

#1630 In pytorch/torchtitan;

· rakkit opened on Aug 25, 2025

allow expert_parallel wrapper to handel kwargs

CLA SignedThis label is managed by the Meta Open Source bot.This label is managed by the Meta Open Source bot.

Status: Closed (abandoned).

pytorch/torchtitannumber 1620

#1620 In pytorch/torchtitan;

· by rakkit was closed on Oct 21, 2025

improve MoE bias update logic in optimizer

CLA SignedThis label is managed by the Meta Open Source bot.This label is managed by the Meta Open Source bot.

release blockingIssues that are blocking the milestone / release completionIssues that are blocking the milestone / release completion

Status: Merged (completed).

pytorch/torchtitannumber 1593

#1593 In pytorch/torchtitan;

· by rakkit was closed on Aug 22, 2025