Skip to content

Pull requests: pytorch/torchtitan

New pull request New
288 Open 2,078 Closed
288 Open 2,078 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[GraphTrainer] Refactor SAC pass: use module_fqn for layer boundaries ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3050 opened Apr 21, 2026 by SherlockNoMad Contributor Loading…
2 tasks done
1
ci: pin torchvision alongside torch in vlm 8-GPU workflow ciflow/rocm-mi300 ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot. module: rocm
#3047 opened Apr 21, 2026 by rishisinhanj Contributor Loading…
6
Support mark_dynamic in minimal_fx_tracer ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3046 opened Apr 21, 2026 by tugsbayasgalan Contributor Loading…
6
[graph_trainer] Add CP support to CooR precompile ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3042 opened Apr 21, 2026 by bobrenjc93 Contributor • Draft
Move RL batch-invariant tests to A10G ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3041 opened Apr 21, 2026 by wwwjn Contributor • Draft
llm_trainer: promote cuda-graph replay on top of fused RoPE ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3040 opened Apr 21, 2026 by bobrenjc93 Contributor • Draft
llm_trainer: promote fused RoPE for llama3 8B tp2 fsdp4 ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3039 opened Apr 21, 2026 by bobrenjc93 Contributor • Draft
[MoE][3/n]swap to torchao dispatcher and set pad_multiple during config time ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3037 opened Apr 20, 2026 by acisseJZhong Contributor • Draft
4 tasks
Enable lora training with simplefsdp ciflow/8gpu
#3035 opened Apr 20, 2026 by jialei777 Loading…
13
quantize on config instead of on model ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3032 opened Apr 20, 2026 by acisseJZhong Contributor Loading…
2 tasks
11
fix(hf_datasets): shuffle HuggingFaceTextDataset on re-loop and replay on resume ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3023 opened Apr 18, 2026 by CrepuscularIRIS Loading…
1
6
[GraphTrainer] Introduce CPU offload pass for activation memory savings ciflow/h100.8 Trigger H100.8 CI ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3015 opened Apr 17, 2026 by mlazos Loading…
2
fix: normalize n_tokens_seen by cp_degree when context parallelism is… ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3009 opened Apr 17, 2026 by TryingtobeingNikhil Loading…
1
14
Fix: reproducible training resume across epoch boundaries for map and streaming datasets ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3008 opened Apr 17, 2026 by slimfrkha Contributor Loading…
7
[HybridEP] Enable HybridEP with graph_trainer ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3007 opened Apr 17, 2026 by syed-ahmed Contributor Loading…
9
[ignore-for-now][llm_trainer] Add experiment for LLM-driven model optimization ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3006 opened Apr 17, 2026 by bobrenjc93 Contributor • Draft
[rl] Generator refactor ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3001 opened Apr 16, 2026 by joecummings Member Loading…
7
[moe] load-balancing aux loss ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#3000 opened Apr 16, 2026 by pianpwk Contributor • Draft
Fix DTensor attr handling in make_fx tracer ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2998 opened Apr 16, 2026 by tugsbayasgalan Contributor Loading…
2
[graph_trainer] Copy forward metadata to backward subgraphs ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2995 opened Apr 16, 2026 by tugsbayasgalan Contributor Loading…
spmd types draft ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2988 opened Apr 15, 2026 by pianpwk Contributor • Draft
[NOT READY FOR REVIEW][Full DTensor] Config-based Full DTensor for Llama3 ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2987 opened Apr 15, 2026 by fegin Contributor • Draft
[Module] Remove LocalMapInnerAttention, use static LocalMapSpec ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2986 opened Apr 15, 2026 by fegin Contributor Loading…
5
Refactor Loss with Scale to fix PP last stage gradients ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2984 opened Apr 15, 2026 by wwwjn Contributor Loading…
1
Increase timeout for features test to 60 minutes. ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2982 opened Apr 15, 2026 by akashveramd Collaborator • Draft
@akashveramd
7
ProTip! Follow long discussions with comments:>50.