I would appreciate any insights you could share about the 2026 roadmap and development scope for TorchTitan. As a user and contributor, understanding the project’s future direction and planned features would be very helpful.
Additionally, is there a plan to train a fully functional and usable MoE (Mixture of Experts) model?