Search results

[Experimental Feature] Huggingface model training

CLA SignedThis label is managed by the Meta Open Source bot.This label is managed by the Meta Open Source bot.

Status: Open (in progress).

pytorch/torchtitannumber 919

#919 In pytorch/torchtitan;

· junjzhang opened on Mar 3, 2025

IBM experimental dataloaders

CLA SignedThis label is managed by the Meta Open Source bot.This label is managed by the Meta Open Source bot.

Status: Open (in progress).

pytorch/torchtitannumber 376

#376 In pytorch/torchtitan;

· daviswer opened on May 31, 2024

[torchtitan][debug] integrated CommDebugMode into TorchTitan

CLA SignedThis label is managed by the Meta Open Source bot.This label is managed by the Meta Open Source bot.

Status: Open (in progress).

pytorch/torchtitannumber 480

#480 In pytorch/torchtitan;

· sinhaanshul opened on Jul 24, 2024

[DO NOT REVIEW] debug fsdp2 checkpoint for uneven sharding

CLA SignedThis label is managed by the Meta Open Source bot.This label is managed by the Meta Open Source bot.

Status: Draft (not ready).

pytorch/torchtitannumber 1635

#1635 In pytorch/torchtitan;

· weifengpy opened on Aug 25, 2025

Distributed Scion/Muon

CLA SignedThis label is managed by the Meta Open Source bot.This label is managed by the Meta Open Source bot.

Status: Open (in progress).

pytorch/torchtitannumber 1630

#1630 In pytorch/torchtitan;

· rakkit opened on Aug 25, 2025

Staging SFT training

CLA SignedThis label is managed by the Meta Open Source bot.This label is managed by the Meta Open Source bot.

Status: Open (in progress).

pytorch/torchtitannumber 2148

#2148 In pytorch/torchtitan;

· rakkit opened on Dec 12, 2025

[WIP] zero bubble

CLA SignedThis label is managed by the Meta Open Source bot.This label is managed by the Meta Open Source bot.

Status: Draft (not ready).

pytorch/torchtitannumber 546

#546 In pytorch/torchtitan;

· H-Huang opened on Aug 20, 2024

[llama4][auxiliary-loss-free load balancing] update expert_bias without backward hooks

CLA SignedThis label is managed by the Meta Open Source bot.This label is managed by the Meta Open Source bot.

Status: Open (in progress).

pytorch/torchtitannumber 1304

#1304 In pytorch/torchtitan;

· hann-wang opened on Jun 16, 2025

[llama3] Add tied weights support

CLA SignedThis label is managed by the Meta Open Source bot.This label is managed by the Meta Open Source bot.

Status: Draft (not ready).

pytorch/torchtitannumber 1409

#1409 In pytorch/torchtitan;

· idoh opened on Jul 17, 2025

[PoC] Enable flexible different layout for same mesh via a util function

CLA SignedThis label is managed by the Meta Open Source bot.This label is managed by the Meta Open Source bot.

Status: Open (in progress).

pytorch/torchtitannumber 1550

#1550 In pytorch/torchtitan;

· fduwjj opened on Aug 11, 2025

Add shims for PyTorch stable

CLA SignedThis label is managed by the Meta Open Source bot.This label is managed by the Meta Open Source bot.

Status: Open (in progress).

pytorch/torchtitannumber 1862

#1862 In pytorch/torchtitan;

· bwasti opened on Oct 13, 2025

Adopt Local Map Wrapper for Inner Attention

ciflow/8gpu

CLA SignedThis label is managed by the Meta Open Source bot.This label is managed by the Meta Open Source bot.

Status: Open (in progress).

pytorch/torchtitannumber 2557

#2557 In pytorch/torchtitan;

· acisseJZhong opened on Mar 11, 2026